Apr 16 14:31:40 devstack cinder-volume[73518]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 14:31:40 devstack cinder-volume[73518]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 14:31:40 devstack cinder-volume[73518]: we strongly recommend against using it for new projects. Apr 16 14:31:40 devstack cinder-volume[73518]: If you are already using Eventlet, we recommend migrating to a different Apr 16 14:31:40 devstack cinder-volume[73518]: framework. For more detail see Apr 16 14:31:40 devstack cinder-volume[73518]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 14:31:40 devstack cinder-volume[73518]: import eventlet # noqa Apr 16 14:31:41 devstack cinder-volume[73518]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73518) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 14:31:41 devstack cinder-volume[73518]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73518) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 14:31:41 devstack cinder-volume[73518]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73518) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 14:31:42 devstack cinder-volume[73518]: INFO dbcounter [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Registered counter for database cinder Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_db.sqlalchemy.engines [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG dbcounter [-] [73518] Writer thread running {{(pid=73518) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 14:31:42 devstack cinder-volume[73518]: INFO cinder.rpc [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 14:31:42 devstack cinder-volume[73518]: INFO cinder.rpc [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_db.sqlalchemy.engines [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:31:42 devstack cinder-volume[73518]: INFO cinder.volume.manager [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Determined volume DB was empty at startup. Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG cinder.volume.manager [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73518) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 14:31:42 devstack cinder-volume[73518]: INFO cinder.volume.manager [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 14:31:42 devstack cinder-volume[73518]: WARNING stevedore.named [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 14:31:42 devstack cinder-volume[73518]: WARNING castellan.key_manager [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 14:31:42 devstack cinder-volume[73518]: WARNING cinder.keymgr.conf_key_mgr [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG cinder.volume.drivers.lvm [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73518) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_concurrency.processutils [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73518) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_concurrency.processutils [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] CMD "cinder-rtstool verify" returned: 0 in 0.245s {{(pid=73518) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_db.sqlalchemy.engines [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:31:42 devstack cinder-volume[73518]: INFO cinder.rpc [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 16 14:31:42 devstack cinder-volume[73518]: INFO cinder.rpc [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 16 14:31:42 devstack cinder-volume[73518]: WARNING stevedore.named [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 14:31:42 devstack cinder-volume[73518]: WARNING castellan.key_manager [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 14:31:42 devstack cinder-volume[73518]: INFO cinder.volume.manager [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_db.sqlalchemy.engines [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:31:42 devstack cinder-volume[73518]: INFO oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Starting 1 workers Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Started child 73630 {{(pid=73518) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Full set of CONF: {{(pid=73518) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] ******************************************************************************** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Configuration options gathered from: {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 14:31:42 devstack cinder-volume[73630]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] ================================================================================ {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] allow_availability_zone_fallback = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] allow_compression_on_image_upload = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] allowed_direct_url_schemes = [] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] api_rate_limit = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] auth_strategy = keystone {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] az_cache_duration = 3600 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_availability_zone = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_host = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_name = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_stats_polling_interval = 60 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backup_api_class = cinder.backup.api.API {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backup_name_template = backup-%s {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backup_use_same_host = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backup_use_temp_snapshot = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] chap_password = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] chap_username = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cinder_internal_tenant_project_id = d1b37f4db477454291694215b279eec0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cinder_internal_tenant_user_id = 9656c10ce10c494289ad3dd69aab820e {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cloned_volume_same_az = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cluster = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] compression_format = gzip {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] compute_api_class = cinder.compute.nova.API {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] config_dir = [] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] config_source = [] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] control_exchange = openstack {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] debug = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] default_availability_zone = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] default_group_type = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] default_volume_type = lvmdriver-1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] disk_geometry = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] driver_client_cert = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] driver_client_cert_key = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] driver_data_namespace = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] driver_ssl_cert_path = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] driver_ssl_cert_verify = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] driver_use_ssl = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] enable_force_upload = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] enable_new_services = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] enable_unsupported_driver = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] enforce_multipath_for_image_xfer = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] filter_function = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance_api_insecure = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance_api_servers = ['http://192.168.122.103/image'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance_api_ssl_compression = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance_ca_certificates_file = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73630]: INFO cinder.volume.manager [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance_catalog_info = image:glance:publicURL {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance_certfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance_keyfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:42 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:42 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance_num_retries = 3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance_request_timeout = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] goodness_function = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] graceful_shutdown_timeout = 5 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] group_api_class = cinder.group.api.API {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] host = devstack {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] image_compress_on_upload = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] image_conversion_address_space_limit = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] image_conversion_cpu_limit = 60 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] image_conversion_disable = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] image_upload_use_cinder_backend = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] image_upload_use_internal_tenant = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] image_volume_cache_enabled = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] image_volume_cache_max_count = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] image_volume_cache_max_size_gb = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] init_host_max_objects_retrieval = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] instance_format = [instance: %(uuid)s] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] iscsi_target_flags = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] iscsi_write_cache = on {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] iser_helper = tgtadm {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] iser_ip_address = 192.168.122.103 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] iser_port = 3260 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] log_color = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] log_config_append = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] log_dir = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] log_file = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] log_options = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] log_rotate_interval = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] log_rotate_interval_type = days {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] log_rotation_type = none {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] max_age = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] max_logfile_count = 30 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] max_logfile_size_mb = 200 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] max_over_subscription_ratio = 20.0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] message_reap_interval = 86400 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] message_ttl = 2592000 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] migration_create_volume_timeout_secs = 300 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] monkey_patch = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] monkey_patch_modules = [] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] my_ip = 192.168.122.103 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] no_snapshot_gb_quota = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] num_iser_scan_tries = 3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] num_shell_tries = 3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] num_volume_device_scan_tries = 3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] nvmeof_conn_info_version = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] nvmet_ns_id = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] nvmet_port_id = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] osapi_max_limit = 1000 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] osapi_volume_ext_list = [] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] osapi_volume_listen_port = 8776 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] osapi_volume_use_ssl = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] osapi_volume_workers = 2 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] per_volume_size_limit = -1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] periodic_fuzzy_delay = 60 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] periodic_interval = 60 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] public_endpoint = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] publish_errors = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] quota_backup_gigabytes = 1000 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] quota_backups = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] quota_gigabytes = 1000 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] quota_groups = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] quota_snapshots = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] quota_volumes = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] rate_limit_burst = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] rate_limit_except_level = CRITICAL {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] rate_limit_interval = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] reinit_driver_count = 3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] replication_device = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] report_discard_supported = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] report_interval = 120 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] reservation_clean_interval = 86400 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] reservation_expire = 86400 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] reserved_image_namespaces = [] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] reserved_percentage = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] rpc_response_timeout = 120 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] run_external_periodic_tasks = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] scst_target_driver = iscsi {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] scst_target_iqn_name = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] service_down_time = 720 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] shell_completion = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] snapshot_name_template = snapshot-%s {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] snapshot_same_host = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] split_loggers = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] state_path = /opt/stack/data/cinder {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] storage_availability_zone = nova {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] storage_protocol = iSCSI {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] syslog_log_facility = LOG_USER {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] target_helper = lioadm {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] target_ip_address = 192.168.122.103 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] target_port = 3260 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] target_protocol = iscsi {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] target_secondary_ip_addresses = [] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] trace_flags = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] transport_url = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] until_refresh = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] use_chap_auth = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] use_default_quota_class = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] use_journal = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] use_json = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] use_multipath_for_image_xfer = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] use_stderr = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] use_syslog = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] verify_glance_signatures = enabled {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_api_class = cinder.volume.api.API {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_backend_name = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_clear = zero {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_clear_ionice = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_clear_size = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_copy_bps_limit = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_dd_blocksize = 1M {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_name_template = volume-%s {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_service_inithost_offload = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volume_usage_audit_period = month {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] zoning_mode = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_concurrency.disable_process_locking = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.admin_password = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.admin_token = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.admin_user = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.auth_port = 35357 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.auth_protocol = https {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.auth_section = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.auth_type = password {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.auth_uri = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.auth_version = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.cache = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.certfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.identity_uri = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.include_service_catalog = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.insecure = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.interface = public {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.keyfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_password = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcache_username = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.region_name = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.service_type = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.103/identity {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.backend = dogpile.cache.null {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.backend_argument = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.backend_expiration_time = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.config_prefix = cache.oslo {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.debug_cache_backend = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.enable_retry_client = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack sudo[73634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.enable_socket_keepalive = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack sudo[73634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.enabled = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.enforce_fips_mode = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.expiration_time = 600 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.hashclient_retry_attempts = 2 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.memcache_dead_retry = 300 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.memcache_pool_maxsize = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.memcache_sasl_enabled = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.password = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.proxies = [] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.redis_db = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.redis_server = localhost:6379 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.retry_attempts = 2 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.retry_delay = 0.0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.socket_keepalive_count = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.socket_keepalive_idle = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.socket_keepalive_interval = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.socket_timeout = 1.0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.tls_allowed_ciphers = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.tls_cafile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.tls_certfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.tls_enabled = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.tls_keyfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cache.username = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] coordination.backend_url = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.asyncio_connection = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.asyncio_slave_connection = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.backend = sqlalchemy {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.connection = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.connection_debug = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.connection_parameters = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.connection_recycle_time = 3600 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.connection_trace = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.db_inc_retry_interval = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.db_max_retries = 20 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.db_max_retry_interval = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.db_retry_interval = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.max_overflow = 50 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.max_pool_size = 5 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.max_retries = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.mysql_wsrep_sync_wait = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.pool_timeout = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.retry_interval = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.slave_connection = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.sqlite_synchronous = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.synchronous_reader = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] database.use_db_reconnect = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler.connection_string = messaging:// {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler.enabled = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler.es_doc_type = notification {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler.es_scroll_size = 10000 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler.es_scroll_time = 2m {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler.filter_error_trace = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler.hmac_keys = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler.sentinel_service_name = mymaster {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler.socket_timeout = 0.1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler.trace_requests = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler.trace_sqlalchemy = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler_jaeger.process_tags = {} {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler_jaeger.service_name_prefix = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] profiler_otlp.service_name_prefix = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_policy.enforce_new_defaults = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: WARNING oslo_config.cfg [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_policy.enforce_scope = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_policy.policy_default_rule = default {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_policy.policy_file = policy.yaml {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] privsep_osbrick.group = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] privsep_osbrick.helper_command = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] privsep_osbrick.user = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cinder_sys_admin.group = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cinder_sys_admin.helper_command = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] cinder_sys_admin.user = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] service_user.auth_section = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] service_user.auth_type = password {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] service_user.cafile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] service_user.certfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] service_user.collect_timing = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] service_user.insecure = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] service_user.keyfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] service_user.send_service_user_token = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] service_user.split_loggers = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] service_user.timeout = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance.auth_section = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance.auth_type = password {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance.certfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance.collect_timing = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance.insecure = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance.keyfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance.region_name = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance.split_loggers = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] glance.timeout = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.backend_availability_zone = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.chap_password = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.chap_username = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.disk_geometry = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.driver_client_cert = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.driver_client_cert_key = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.driver_data_namespace = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.driver_use_ssl = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.extra_capabilities = {} {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.filter_function = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.goodness_function = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.iscsi_target_flags = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.iscsi_write_cache = on {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.iser_helper = tgtadm {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.iser_ip_address = 192.168.122.103 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.iser_port = 3260 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.lvm_share_target = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.lvm_type = auto {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.num_shell_tries = 3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.replication_device = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.report_discard_supported = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.reserved_percentage = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.target_helper = tgtadm {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.target_ip_address = 192.168.122.103 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.target_port = 3260 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.target_protocol = iscsi {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.trace_flags = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.unique_fqdn_network = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.use_chap_auth = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.volume_backend_name = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.volume_clear = zero {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.volume_clear_ionice = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.volume_clear_size = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_reports.file_event_handler = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_reports.log_dir = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.backend_host = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.chap_password = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.chap_username = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.disk_geometry = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.driver_client_cert = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.extra_capabilities = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.filter_function = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.goodness_function = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.iser_helper = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.iser_ip_address = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.iser_port = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.lvm_share_target = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.lvm_type = auto {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.num_shell_tries = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.replication_device = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.report_discard_supported = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.reserved_percentage = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.scst_target_driver = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.storage_protocol = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.target_helper = lioadm {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.target_ip_address = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.target_port = 3260 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.trace_flags = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.use_chap_auth = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.volume_clear = zero {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.volume_clear_size = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] lvmdriver-1.volumes_dir = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.ssl = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_notifications.driver = [] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_notifications.retry = -1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] key_manager.fixed_key = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.barbican_api_version = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.barbican_endpoint = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.barbican_endpoint_type = public {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.barbican_region_name = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.cafile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.certfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.collect_timing = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.insecure = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.keyfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.number_of_retries = 60 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.retry_delay = 1 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.send_service_user_token = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.split_loggers = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.timeout = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.verify_ssl = True {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican.verify_ssl_path = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican_service_user.auth_section = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican_service_user.auth_type = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican_service_user.cafile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican_service_user.certfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican_service_user.collect_timing = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican_service_user.insecure = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican_service_user.keyfile = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican_service_user.split_loggers = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] barbican_service_user.timeout = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vault.approle_role_id = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vault.approle_secret_id = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vault.kv_mountpoint = secret {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vault.kv_path = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vault.kv_version = 2 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vault.namespace = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vault.root_token_id = **** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vault.ssl_ca_crt_file = None {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vault.timeout = 60.0 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vault.use_ssl = False {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:31:43 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] ******************************************************************************** {{(pid=73518) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 14:31:43 devstack sudo[73634]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:43 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.519s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:43 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:43 devstack sudo[73644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 14:31:43 devstack sudo[73644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:44 devstack sudo[73644]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:44 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.481s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:44 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:31:44 devstack cinder-volume[73630]: INFO cinder.brick.local_dev.lvm [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 16 14:31:44 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:44 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:44 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:44 devstack sudo[73836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 14:31:44 devstack sudo[73836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:44 devstack sudo[73836]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:44 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.513s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:44 devstack cinder-volume[73630]: DEBUG cinder.brick.local_dev.lvm [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73630) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 16 14:31:44 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:44 devstack sudo[74031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 14:31:44 devstack sudo[74031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:45 devstack sudo[74031]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:45 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.905s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:45 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:45 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:45 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:45 devstack sudo[74241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 14:31:45 devstack sudo[74241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:46 devstack sudo[74241]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:46 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:46 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:46 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:46 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:46 devstack sudo[74326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 16 14:31:46 devstack sudo[74326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:46 devstack sudo[74326]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:46 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.453s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:46 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:46 devstack sudo[74333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 14:31:46 devstack sudo[74333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:46 devstack sudo[74333]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:46 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:46 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:46 devstack sudo[74336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 14:31:46 devstack sudo[74336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:47 devstack sudo[74336]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:47 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:47 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:47 devstack sudo[74344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 14:31:47 devstack sudo[74344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:47 devstack sudo[74344]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:47 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:47 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:47 devstack sudo[74348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 14:31:47 devstack sudo[74348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:48 devstack sudo[74348]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:48 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:48 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:48 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:48 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:48 devstack sudo[74354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 14:31:48 devstack sudo[74354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:48 devstack sudo[74354]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:48 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.450s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:48 devstack cinder-volume[73630]: INFO cinder.volume.drivers.lvm [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 16 14:31:48 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:48 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:48 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:48 devstack sudo[74358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 14:31:48 devstack sudo[74358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:49 devstack sudo[74358]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:49 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:49 devstack cinder-volume[73630]: DEBUG cinder.volume.drivers.lvm [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Updating volume stats {{(pid=73630) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 14:31:49 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:49 devstack sudo[74370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 14:31:49 devstack sudo[74370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:49 devstack sudo[74370]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:49 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:49 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:49 devstack sudo[74483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 14:31:49 devstack sudo[74483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:50 devstack sudo[74483]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:50 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:50 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:50 devstack sudo[74486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 14:31:50 devstack sudo[74486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:50 devstack sudo[74486]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:50 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.427s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:50 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:50 devstack sudo[74624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 14:31:50 devstack sudo[74624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:51 devstack sudo[74624]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:51 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:51 devstack cinder-volume[73630]: INFO cinder.volume.driver [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 14:31:51 devstack cinder-volume[73630]: DEBUG cinder.volume.driver [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73630) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 14:31:51 devstack cinder-volume[73630]: DEBUG oslo_db.sqlalchemy.engines [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73630) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:31:51 devstack cinder-volume[73630]: DEBUG dbcounter [-] [73630] Writer thread running {{(pid=73630) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 14:31:51 devstack cinder-volume[73630]: DEBUG cinder.db.sqlalchemy.api [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Building query based on filter {{(pid=73630) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 14:31:51 devstack cinder-volume[73630]: DEBUG cinder.image.image_utils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73630) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 14:31:51 devstack cinder-volume[73630]: INFO cinder.keymgr.migration [None req-e3d3fddf-a77d-413b-840d-75ee58b0e2a2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 14:31:51 devstack cinder-volume[73630]: DEBUG cinder.volume.drivers.lvm [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Updating volume stats {{(pid=73630) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 14:31:51 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:51 devstack sudo[74630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 14:31:51 devstack sudo[74630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:51 devstack sudo[74630]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:51 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:51 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:51 devstack sudo[74637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 14:31:51 devstack sudo[74637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:52 devstack sudo[74637]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:52 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:52 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:52 devstack sudo[74640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 14:31:52 devstack sudo[74640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:52 devstack sudo[74640]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:52 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:52 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:52 devstack sudo[74645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 14:31:52 devstack sudo[74645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:52 devstack cinder-volume[73518]: DEBUG dbcounter [-] [73518] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73518) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:31:53 devstack sudo[74645]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:53 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:53 devstack cinder-volume[73630]: DEBUG cinder.manager [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Notifying Schedulers of capabilities ... {{(pid=73630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:31:53 devstack cinder-volume[73630]: INFO cinder.volume.manager [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Driver initialization completed successfully. Apr 16 14:31:53 devstack cinder-volume[73630]: INFO cinder.manager [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Initiating service 2 cleanup Apr 16 14:31:53 devstack cinder-volume[73630]: INFO cinder.manager [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Service 2 cleanup completed. Apr 16 14:31:53 devstack cinder-volume[73630]: DEBUG cinder.service [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Creating RPC server for service cinder-volume {{(pid=73630) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 14:31:53 devstack cinder-volume[73630]: DEBUG cinder.service [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73630) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 14:31:53 devstack cinder-volume[73630]: INFO cinder.volume.manager [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 16 14:31:53 devstack cinder-volume[73630]: DEBUG cinder.volume.drivers.lvm [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Updating volume stats {{(pid=73630) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 14:31:53 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:53 devstack sudo[74650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 14:31:53 devstack sudo[74650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:53 devstack sudo[74650]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:53 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:53 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:53 devstack sudo[74657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 14:31:53 devstack sudo[74657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:54 devstack sudo[74657]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:54 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:54 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:54 devstack sudo[74661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 14:31:54 devstack sudo[74661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:54 devstack sudo[74661]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:54 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.471s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:54 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:31:54 devstack sudo[74664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 14:31:54 devstack sudo[74664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:31:55 devstack sudo[74664]: pam_unix(sudo:session): session closed for user root Apr 16 14:31:55 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:31:55 devstack cinder-volume[73630]: INFO cinder.volume.manager [None req-84f3fa07-3807-4a71-9d95-d01f2cb5b2a4 None None] Driver post RPC initialization completed successfully. Apr 16 14:32:05 devstack cinder-volume[73630]: DEBUG dbcounter [-] [73630] Writing DB stats cinder:SELECT=4 {{(pid=73630) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:32:05 devstack cinder-volume[73630]: DEBUG dbcounter [-] [73630] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73630) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:33:27 devstack cinder-volume[73630]: DEBUG oslo_service.periodic_task [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:33:27 devstack cinder-volume[73630]: DEBUG cinder.volume.drivers.lvm [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Updating volume stats {{(pid=73630) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 14:33:27 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:33:27 devstack sudo[79740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 14:33:27 devstack sudo[79740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:33:27 devstack sudo[79740]: pam_unix(sudo:session): session closed for user root Apr 16 14:33:27 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:33:27 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:33:27 devstack sudo[79743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 14:33:27 devstack sudo[79743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:33:27 devstack sudo[79743]: pam_unix(sudo:session): session closed for user root Apr 16 14:33:27 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:33:27 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:33:27 devstack sudo[79746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 14:33:27 devstack sudo[79746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:33:28 devstack sudo[79746]: pam_unix(sudo:session): session closed for user root Apr 16 14:33:28 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:33:28 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:33:28 devstack sudo[79749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 14:33:28 devstack sudo[79749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:33:28 devstack sudo[79749]: pam_unix(sudo:session): session closed for user root Apr 16 14:33:28 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:33:28 devstack cinder-volume[73630]: DEBUG cinder.manager [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Notifying Schedulers of capabilities ... {{(pid=73630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:34:05 devstack cinder-volume[73630]: DEBUG dbcounter [-] [73630] Writing DB stats cinder:SELECT=1 {{(pid=73630) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:34:05 devstack cinder-volume[73630]: DEBUG dbcounter [-] [73630] Writing DB stats cinder:UPDATE=1 {{(pid=73630) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:34:27 devstack cinder-volume[73630]: DEBUG oslo_service.periodic_task [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:34:27 devstack cinder-volume[73630]: DEBUG cinder.volume.drivers.lvm [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Updating volume stats {{(pid=73630) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 14:34:27 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:34:27 devstack sudo[81707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 14:34:27 devstack sudo[81707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:34:27 devstack sudo[81707]: pam_unix(sudo:session): session closed for user root Apr 16 14:34:27 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:34:27 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:34:27 devstack sudo[81721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 14:34:27 devstack sudo[81721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:34:27 devstack sudo[81721]: pam_unix(sudo:session): session closed for user root Apr 16 14:34:27 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.417s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:34:27 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:34:27 devstack sudo[81724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 14:34:27 devstack sudo[81724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:34:28 devstack sudo[81724]: pam_unix(sudo:session): session closed for user root Apr 16 14:34:28 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.436s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:34:28 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:34:28 devstack sudo[81750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 14:34:28 devstack sudo[81750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:34:28 devstack sudo[81750]: pam_unix(sudo:session): session closed for user root Apr 16 14:34:28 devstack cinder-volume[73630]: DEBUG oslo_concurrency.processutils [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=73630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:34:28 devstack cinder-volume[73630]: DEBUG cinder.manager [None req-112d5779-9903-4e7e-9f73-f6614067b802 None None] Notifying Schedulers of capabilities ... {{(pid=73630) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:35:12 devstack cinder-volume[73518]: INFO oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Caught SIGTERM, stopping children Apr 16 14:35:12 devstack cinder-volume[73518]: DEBUG oslo_concurrency.lockutils [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Acquiring lock "singleton_lock" {{(pid=73518) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 14:35:12 devstack cinder-volume[73518]: DEBUG oslo_concurrency.lockutils [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Acquired lock "singleton_lock" {{(pid=73518) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 14:35:12 devstack cinder-volume[73518]: DEBUG oslo_concurrency.lockutils [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Releasing lock "singleton_lock" {{(pid=73518) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 14:35:12 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Stop services. {{(pid=73518) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 14:35:12 devstack cinder-volume[73518]: DEBUG oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Killing children. {{(pid=73518) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 14:35:12 devstack cinder-volume[73518]: INFO oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Waiting on 1 children to exit Apr 16 14:35:13 devstack cinder-volume[73630]: DEBUG oslo_concurrency.lockutils [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Acquiring lock "singleton_lock" {{(pid=73630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 14:35:13 devstack cinder-volume[73630]: DEBUG oslo_concurrency.lockutils [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Acquired lock "singleton_lock" {{(pid=73630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 14:35:13 devstack cinder-volume[73630]: DEBUG oslo_concurrency.lockutils [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Releasing lock "singleton_lock" {{(pid=73630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 14:35:13 devstack cinder-volume[73630]: WARNING amqp [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 14:35:13 devstack cinder-volume[73630]: WARNING amqp [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 14:35:13 devstack cinder-volume[73518]: INFO oslo_service.backend._eventlet.service [None req-95534a63-0475-48f3-b519-769f1db73a47 None None] Child 73630 exited with status 0 Apr 16 14:35:13 devstack cinder-volume[82714]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 14:35:13 devstack cinder-volume[82714]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 14:35:13 devstack cinder-volume[82714]: we strongly recommend against using it for new projects. Apr 16 14:35:13 devstack cinder-volume[82714]: If you are already using Eventlet, we recommend migrating to a different Apr 16 14:35:13 devstack cinder-volume[82714]: framework. For more detail see Apr 16 14:35:13 devstack cinder-volume[82714]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 14:35:13 devstack cinder-volume[82714]: import eventlet # noqa Apr 16 14:35:15 devstack cinder-volume[82714]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 14:35:15 devstack cinder-volume[82714]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 14:35:15 devstack cinder-volume[82714]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 14:35:15 devstack cinder-volume[82714]: INFO dbcounter [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Registered counter for database cinder Apr 16 14:35:15 devstack cinder-volume[82714]: DEBUG oslo_db.sqlalchemy.engines [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG dbcounter [-] [82714] Writer thread running {{(pid=82714) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 14:35:16 devstack cinder-volume[82714]: INFO cinder.rpc [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 14:35:16 devstack cinder-volume[82714]: INFO cinder.rpc [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_db.sqlalchemy.engines [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:35:16 devstack cinder-volume[82714]: INFO cinder.volume.manager [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Determined volume DB was empty at startup. Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG cinder.volume.manager [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82714) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 14:35:16 devstack cinder-volume[82714]: INFO cinder.volume.manager [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 14:35:16 devstack cinder-volume[82714]: WARNING stevedore.named [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 14:35:16 devstack cinder-volume[82714]: WARNING castellan.key_manager [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 14:35:16 devstack cinder-volume[82714]: WARNING cinder.keymgr.conf_key_mgr [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 14:35:16 devstack cinder-volume[82714]: INFO cinder.volume.manager [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_db.sqlalchemy.engines [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:35:16 devstack cinder-volume[82714]: INFO oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Starting 1 workers Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Started child 82832 {{(pid=82714) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Full set of CONF: {{(pid=82714) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] ******************************************************************************** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Configuration options gathered from: {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] ================================================================================ {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] allow_availability_zone_fallback = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82832]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] allow_compression_on_image_upload = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] allowed_direct_url_schemes = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] api_rate_limit = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] auth_strategy = keystone {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_availability_zone = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_host = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_stats_polling_interval = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backup_api_class = cinder.backup.api.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backup_name_template = backup-%s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backup_use_same_host = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backup_use_temp_snapshot = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] chap_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] chap_username = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cinder_internal_tenant_project_id = d1b37f4db477454291694215b279eec0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cinder_internal_tenant_user_id = 9656c10ce10c494289ad3dd69aab820e {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cluster = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] compression_format = gzip {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] compute_api_class = cinder.compute.nova.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] config_dir = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] config_source = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] control_exchange = openstack {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] debug = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] default_availability_zone = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] default_group_type = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] default_volume_type = QuobyteHD {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] disk_geometry = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] driver_client_cert = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] driver_client_cert_key = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] driver_data_namespace = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] driver_ssl_cert_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] driver_ssl_cert_verify = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] driver_use_ssl = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] enable_new_services = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] enable_unsupported_driver = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] enabled_backends = ['QuobyteHD'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] enforce_multipath_for_image_xfer = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] filter_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance_api_insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance_api_servers = ['http://192.168.122.103/image'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance_api_ssl_compression = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance_ca_certificates_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance_catalog_info = image:glance:publicURL {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance_certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance_keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance_num_retries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance_request_timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] goodness_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] graceful_shutdown_timeout = 5 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] group_api_class = cinder.group.api.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] host = devstack {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] image_compress_on_upload = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] image_conversion_address_space_limit = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] image_conversion_cpu_limit = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] image_conversion_disable = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] image_upload_use_cinder_backend = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] image_upload_use_internal_tenant = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] image_volume_cache_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] image_volume_cache_max_count = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] image_volume_cache_max_size_gb = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] init_host_max_objects_retrieval = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] instance_format = [instance: %(uuid)s] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] iscsi_target_flags = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] iscsi_write_cache = on {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] iser_helper = tgtadm {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] iser_ip_address = 192.168.122.103 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] iser_port = 3260 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] log_color = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] log_config_append = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] log_dir = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] log_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] log_options = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] log_rotate_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] log_rotate_interval_type = days {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] log_rotation_type = none {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82832]: INFO cinder.volume.manager [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] max_age = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] max_logfile_count = 30 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG cinder.volume.drivers.remotefs [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82832) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] max_logfile_size_mb = 200 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] max_over_subscription_ratio = 20.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] message_reap_interval = 86400 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] message_ttl = 2592000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] migration_create_volume_timeout_secs = 300 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] monkey_patch = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] monkey_patch_modules = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] my_ip = 192.168.122.103 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] no_snapshot_gb_quota = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] num_iser_scan_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] num_shell_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] num_volume_device_scan_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] nvmeof_conn_info_version = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] nvmet_ns_id = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] nvmet_port_id = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] osapi_max_limit = 1000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] osapi_volume_ext_list = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] osapi_volume_listen_port = 8776 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] osapi_volume_use_ssl = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] osapi_volume_workers = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] per_volume_size_limit = -1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] periodic_fuzzy_delay = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] periodic_interval = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] public_endpoint = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] publish_errors = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] quota_backup_gigabytes = 1000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] quota_backups = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] quota_gigabytes = 1000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] quota_groups = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] quota_snapshots = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] quota_volumes = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] rate_limit_burst = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] rate_limit_except_level = CRITICAL {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] rate_limit_interval = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] reinit_driver_count = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] replication_device = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] report_discard_supported = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] report_interval = 120 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] reservation_clean_interval = 86400 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] reservation_expire = 86400 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] reserved_image_namespaces = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] reserved_percentage = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] rpc_response_timeout = 120 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] run_external_periodic_tasks = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] scst_target_driver = iscsi {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] scst_target_iqn_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] service_down_time = 720 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] shell_completion = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] snapshot_name_template = snapshot-%s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] split_loggers = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] state_path = /opt/stack/data/cinder {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] storage_availability_zone = nova {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] storage_protocol = iSCSI {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] syslog_log_facility = LOG_USER {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] target_helper = lioadm {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] target_ip_address = 192.168.122.103 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] target_port = 3260 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] target_protocol = iscsi {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] target_secondary_ip_addresses = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] trace_flags = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] transport_url = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] until_refresh = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] use_chap_auth = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] use_default_quota_class = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] use_journal = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] use_json = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] use_multipath_for_image_xfer = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] use_stderr = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] use_syslog = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] verify_glance_signatures = enabled {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_api_class = cinder.volume.api.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_backend_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_clear = zero {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_clear_ionice = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_clear_size = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_copy_bps_limit = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_dd_blocksize = 1M {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_name_template = volume-%s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_service_inithost_offload = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volume_usage_audit_period = month {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] zoning_mode = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_concurrency.disable_process_locking = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.admin_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.admin_token = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.admin_user = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.auth_port = 35357 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.auth_protocol = https {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.auth_section = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.auth_type = password {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.auth_uri = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.auth_version = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.cache = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.identity_uri = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.include_service_catalog = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.interface = public {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_password = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcache_username = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.region_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.service_type = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.103/identity {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.backend = dogpile.cache.null {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.backend_argument = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.backend_expiration_time = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.config_prefix = cache.oslo {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.debug_cache_backend = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.enable_retry_client = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.enable_socket_keepalive = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.enforce_fips_mode = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.expiration_time = 600 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.hashclient_retry_attempts = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.memcache_dead_retry = 300 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.memcache_pool_maxsize = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG cinder.volume.drivers.quobyte [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82832) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.memcache_sasl_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.proxies = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.redis_db = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82832]: WARNING cinder.volume.drivers.quobyte [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82832]: WARNING cinder.volume.drivers.quobyte [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.redis_server = localhost:6379 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.retry_attempts = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.retry_delay = 0.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.socket_keepalive_count = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.socket_keepalive_idle = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Running cmd (subprocess): mount.quobyte {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.socket_keepalive_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.socket_timeout = 1.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.tls_allowed_ciphers = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.tls_cafile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.tls_certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.tls_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.tls_keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cache.username = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] coordination.backend_url = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.asyncio_connection = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.asyncio_slave_connection = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.backend = sqlalchemy {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.connection = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.connection_debug = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.connection_parameters = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.connection_recycle_time = 3600 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.connection_trace = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.db_inc_retry_interval = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.db_max_retries = 20 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.db_max_retry_interval = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.db_retry_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.max_overflow = 50 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.max_pool_size = 5 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.max_retries = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.mysql_wsrep_sync_wait = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.pool_timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.retry_interval = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.slave_connection = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.sqlite_synchronous = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.synchronous_reader = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] database.use_db_reconnect = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler.connection_string = messaging:// {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler.enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler.es_doc_type = notification {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler.es_scroll_size = 10000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler.es_scroll_time = 2m {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler.filter_error_trace = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler.hmac_keys = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler.sentinel_service_name = mymaster {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler.socket_timeout = 0.1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler.trace_requests = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler.trace_sqlalchemy = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler_jaeger.process_tags = {} {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler_jaeger.service_name_prefix = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] profiler_otlp.service_name_prefix = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_policy.enforce_new_defaults = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: WARNING oslo_config.cfg [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_policy.enforce_scope = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_policy.policy_default_rule = default {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_policy.policy_file = policy.yaml {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] privsep_osbrick.group = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] privsep_osbrick.helper_command = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] privsep_osbrick.user = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cinder_sys_admin.group = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cinder_sys_admin.helper_command = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] cinder_sys_admin.user = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] service_user.auth_section = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] service_user.auth_type = password {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] service_user.cafile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] service_user.certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] service_user.collect_timing = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] service_user.insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] service_user.keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] service_user.send_service_user_token = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] service_user.split_loggers = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] service_user.timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance.auth_section = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance.auth_type = password {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance.certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance.collect_timing = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance.insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance.keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance.region_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance.split_loggers = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] glance.timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.backend_availability_zone = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.chap_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.chap_username = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.disk_geometry = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.driver_client_cert = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.driver_client_cert_key = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.driver_data_namespace = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.driver_use_ssl = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.extra_capabilities = {} {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.filter_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.goodness_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.iscsi_target_flags = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.iscsi_write_cache = on {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.iser_helper = tgtadm {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.iser_ip_address = 192.168.122.103 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.iser_port = 3260 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nas_host = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nas_login = admin {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nas_mount_options = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nas_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nas_private_key = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nas_share_path = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.num_shell_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.quobyte_volume_url = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.replication_device = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.report_discard_supported = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.reserved_percentage = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.target_helper = tgtadm {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.target_ip_address = 192.168.122.103 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.target_port = 3260 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.target_protocol = iscsi {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.trace_flags = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.unique_fqdn_network = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.use_chap_auth = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.volume_backend_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.volume_clear = zero {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.volume_clear_ionice = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.volume_clear_size = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_reports.file_event_handler = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_reports.log_dir = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.backend_availability_zone = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.backend_host = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.chap_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.chap_username = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.chiscsi_conf = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.disk_geometry = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.driver_client_cert = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.driver_data_namespace = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.driver_use_ssl = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.extra_capabilities = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.filter_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.goodness_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.iser_helper = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.iser_ip_address = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.iser_port = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.iser_target_prefix = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nas_host = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nas_login = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nas_mount_options = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nas_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nas_private_key = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nas_share_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nas_ssh_port = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.num_shell_tries = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack quobyte-client[82833]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 14:35:16 devstack quobyte-client[82833]: Invalid parameters found, error: missing mount point. Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.nvmet_port_id = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack quobyte-client[82833]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 14:35:16 devstack quobyte-client[82833]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.replication_device = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.report_discard_supported = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.reserved_percentage = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.scst_target_driver = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.storage_protocol = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.target_helper = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.target_ip_address = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.target_port = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.target_prefix = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.target_protocol = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.trace_flags = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.use_chap_auth = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.volume_clear = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.volume_clear_size = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] QuobyteHD.volumes_dir = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG cinder.volume.drivers.quobyte [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=82832) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82832]: INFO cinder.volume.drivers.quobyte [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 ... Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d -c /etc/quobyte/client-cinder.cfg {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.ssl = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_notifications.driver = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_notifications.retry = -1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] key_manager.fixed_key = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.barbican_api_version = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.barbican_endpoint = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.barbican_endpoint_type = public {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.barbican_region_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.cafile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.collect_timing = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.number_of_retries = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.retry_delay = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.send_service_user_token = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.split_loggers = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.verify_ssl = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican.verify_ssl_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican_service_user.auth_section = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican_service_user.auth_type = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican_service_user.cafile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican_service_user.certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican_service_user.collect_timing = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican_service_user.insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican_service_user.keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican_service_user.split_loggers = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] barbican_service_user.timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vault.approle_role_id = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vault.approle_secret_id = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vault.kv_mountpoint = secret {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vault.kv_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vault.kv_version = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vault.namespace = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vault.root_token_id = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vault.ssl_ca_crt_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vault.timeout = 60.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vault.use_ssl = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:16 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] ******************************************************************************** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 14:35:16 devstack sudo[82834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d -c /etc/quobyte/client-cinder.cfg Apr 16 14:35:16 devstack sudo[82834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:35:16 devstack sudo[82834]: pam_unix(sudo:session): session closed for user root Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.524s {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:35:16 devstack cinder-volume[82832]: INFO cinder.volume.drivers.quobyte [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 succeeded Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG cinder.volume.drivers.quobyte [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=82832) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.531s {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:35:16 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:35:16 devstack sudo[82903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:35:16 devstack sudo[82903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:35:17 devstack sudo[82903]: pam_unix(sudo:session): session closed for user root Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.650s {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:35:17 devstack cinder-volume[82832]: INFO cinder.volume.driver [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG cinder.volume.driver [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82832) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG oslo_db.sqlalchemy.engines [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82832) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG dbcounter [-] [82832] Writer thread running {{(pid=82832) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG cinder.db.sqlalchemy.api [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Building query based on filter {{(pid=82832) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG cinder.image.image_utils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82832) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 14:35:17 devstack cinder-volume[82832]: INFO cinder.keymgr.migration [None req-fde37f0f-ffa2-45d9-b0c6-caf1b0ccd1b9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG cinder.volume.drivers.quobyte [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=82832) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG cinder.volume.drivers.quobyte [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=82832) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:35:17 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:35:17 devstack sudo[82932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:35:17 devstack sudo[82932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:35:18 devstack sudo[82932]: pam_unix(sudo:session): session closed for user root Apr 16 14:35:18 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.512s {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:35:18 devstack cinder-volume[82832]: DEBUG cinder.manager [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Notifying Schedulers of capabilities ... {{(pid=82832) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:35:18 devstack cinder-volume[82832]: INFO cinder.volume.manager [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Driver initialization completed successfully. Apr 16 14:35:18 devstack cinder-volume[82832]: INFO cinder.manager [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Initiating service 3 cleanup Apr 16 14:35:18 devstack cinder-volume[82832]: INFO cinder.manager [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Service 3 cleanup completed. Apr 16 14:35:18 devstack cinder-volume[82832]: DEBUG cinder.service [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Creating RPC server for service cinder-volume {{(pid=82832) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 14:35:18 devstack cinder-volume[82832]: DEBUG cinder.service [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82832) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 14:35:18 devstack cinder-volume[82832]: INFO cinder.volume.manager [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 14:35:18 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:35:18 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:35:18 devstack cinder-volume[82832]: DEBUG cinder.volume.drivers.quobyte [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=82832) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:35:18 devstack cinder-volume[82832]: DEBUG cinder.volume.drivers.quobyte [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=82832) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:35:18 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:35:18 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:35:18 devstack sudo[82970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:35:18 devstack sudo[82970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:35:18 devstack sudo[82970]: pam_unix(sudo:session): session closed for user root Apr 16 14:35:18 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.387s {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:35:18 devstack cinder-volume[82832]: INFO cinder.volume.manager [None req-0450de3e-e6ae-4c26-9704-4d613c384620 None None] Driver post RPC initialization completed successfully. Apr 16 14:35:20 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-a806e73e-1e18-47ca-8f15-c1c20783a16e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:35:20 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-a806e73e-1e18-47ca-8f15-c1c20783a16e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:35:20 devstack cinder-volume[82832]: DEBUG cinder.volume.drivers.quobyte [None req-a806e73e-1e18-47ca-8f15-c1c20783a16e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=82832) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:35:20 devstack cinder-volume[82832]: DEBUG cinder.volume.drivers.quobyte [None req-a806e73e-1e18-47ca-8f15-c1c20783a16e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=82832) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:35:20 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-a806e73e-1e18-47ca-8f15-c1c20783a16e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82832) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:35:20 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-a806e73e-1e18-47ca-8f15-c1c20783a16e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:35:20 devstack sudo[83004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:35:20 devstack sudo[83004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:35:20 devstack sudo[83004]: pam_unix(sudo:session): session closed for user root Apr 16 14:35:20 devstack cinder-volume[82832]: DEBUG oslo_concurrency.processutils [None req-a806e73e-1e18-47ca-8f15-c1c20783a16e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.393s {{(pid=82832) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:35:20 devstack cinder-volume[82832]: DEBUG cinder.manager [None req-a806e73e-1e18-47ca-8f15-c1c20783a16e None None] Notifying Schedulers of capabilities ... {{(pid=82832) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:35:20 devstack cinder-volume[82714]: INFO oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Caught SIGTERM, stopping children Apr 16 14:35:20 devstack cinder-volume[82714]: DEBUG oslo_concurrency.lockutils [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Acquiring lock "singleton_lock" {{(pid=82714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 14:35:20 devstack cinder-volume[82714]: DEBUG oslo_concurrency.lockutils [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Acquired lock "singleton_lock" {{(pid=82714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 14:35:20 devstack cinder-volume[82714]: DEBUG oslo_concurrency.lockutils [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Releasing lock "singleton_lock" {{(pid=82714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 14:35:20 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Stop services. {{(pid=82714) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 14:35:20 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Killing children. {{(pid=82714) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 14:35:20 devstack cinder-volume[82714]: INFO oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Waiting on 1 children to exit Apr 16 14:35:22 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Acquiring lock "singleton_lock" {{(pid=82832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 14:35:22 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Acquired lock "singleton_lock" {{(pid=82832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 14:35:22 devstack cinder-volume[82832]: DEBUG oslo_concurrency.lockutils [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Releasing lock "singleton_lock" {{(pid=82832) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 14:35:22 devstack cinder-volume[82832]: WARNING amqp [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 14:35:22 devstack cinder-volume[82832]: WARNING amqp [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 14:35:22 devstack cinder-volume[82714]: INFO oslo_service.backend._eventlet.service [None req-10bca349-76ae-403d-b7c0-00404d9448f6 None None] Child 82832 exited with status 0 Apr 16 14:35:22 devstack cinder-volume[83091]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 14:35:22 devstack cinder-volume[83091]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 14:35:22 devstack cinder-volume[83091]: we strongly recommend against using it for new projects. Apr 16 14:35:22 devstack cinder-volume[83091]: If you are already using Eventlet, we recommend migrating to a different Apr 16 14:35:22 devstack cinder-volume[83091]: framework. For more detail see Apr 16 14:35:22 devstack cinder-volume[83091]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 14:35:22 devstack cinder-volume[83091]: import eventlet # noqa Apr 16 14:35:24 devstack cinder-volume[83091]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 14:35:24 devstack cinder-volume[83091]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 14:35:24 devstack cinder-volume[83091]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 14:35:25 devstack cinder-volume[83091]: INFO dbcounter [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Registered counter for database cinder Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_db.sqlalchemy.engines [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83091) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG dbcounter [-] [83091] Writer thread running {{(pid=83091) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 14:35:25 devstack cinder-volume[83091]: INFO cinder.rpc [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 14:35:25 devstack cinder-volume[83091]: INFO cinder.rpc [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_db.sqlalchemy.engines [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83091) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:35:25 devstack cinder-volume[83091]: INFO cinder.volume.manager [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Determined volume DB was empty at startup. Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG cinder.volume.manager [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83091) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 14:35:25 devstack cinder-volume[83091]: WARNING stevedore.named [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 14:35:25 devstack cinder-volume[83091]: WARNING castellan.key_manager [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 14:35:25 devstack cinder-volume[83091]: WARNING cinder.keymgr.conf_key_mgr [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 14:35:25 devstack cinder-volume[83091]: INFO cinder.volume.manager [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_db.sqlalchemy.engines [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83091) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:35:25 devstack cinder-volume[83091]: INFO oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Starting 1 workers Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Started child 83305 {{(pid=83091) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Full set of CONF: {{(pid=83091) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] ******************************************************************************** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Configuration options gathered from: {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] ================================================================================ {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 14:35:25 devstack cinder-volume[83305]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] allow_availability_zone_fallback = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] allow_compression_on_image_upload = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] allowed_direct_url_schemes = [] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] api_rate_limit = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] auth_strategy = keystone {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_availability_zone = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_host = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_name = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_stats_polling_interval = 60 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backup_api_class = cinder.backup.api.API {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backup_name_template = backup-%s {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backup_use_same_host = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backup_use_temp_snapshot = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] chap_password = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] chap_username = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cinder_internal_tenant_project_id = d1b37f4db477454291694215b279eec0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cinder_internal_tenant_user_id = 9656c10ce10c494289ad3dd69aab820e {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cluster = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] compression_format = gzip {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] compute_api_class = cinder.compute.nova.API {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] config_dir = [] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] config_source = [] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] control_exchange = openstack {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] debug = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] default_availability_zone = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] default_group_type = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] default_volume_type = QuobyteHD {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] disk_geometry = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] driver_client_cert = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] driver_client_cert_key = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] driver_data_namespace = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] driver_ssl_cert_path = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] driver_ssl_cert_verify = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] driver_use_ssl = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] enable_new_services = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] enable_unsupported_driver = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] enabled_backends = ['QuobyteHD'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] enforce_multipath_for_image_xfer = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] filter_function = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance_api_insecure = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance_api_servers = ['http://192.168.122.103/image'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance_api_ssl_compression = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance_ca_certificates_file = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance_catalog_info = image:glance:publicURL {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance_certfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance_keyfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance_num_retries = 3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance_request_timeout = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] goodness_function = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] graceful_shutdown_timeout = 5 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] group_api_class = cinder.group.api.API {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] host = devstack {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] image_compress_on_upload = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] image_conversion_address_space_limit = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] image_conversion_cpu_limit = 60 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83305) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] image_conversion_disable = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] image_upload_use_cinder_backend = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] image_upload_use_internal_tenant = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] image_volume_cache_enabled = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] image_volume_cache_max_count = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] image_volume_cache_max_size_gb = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] init_host_max_objects_retrieval = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] instance_format = [instance: %(uuid)s] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] iscsi_target_flags = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] iscsi_write_cache = on {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] iser_helper = tgtadm {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] iser_ip_address = 192.168.122.103 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] iser_port = 3260 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] log_color = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] log_config_append = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] log_dir = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] log_file = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] log_options = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] log_rotate_interval = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] log_rotate_interval_type = days {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] log_rotation_type = none {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] max_age = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] max_logfile_count = 30 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] max_logfile_size_mb = 200 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] max_over_subscription_ratio = 20.0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] message_reap_interval = 86400 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] message_ttl = 2592000 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] migration_create_volume_timeout_secs = 300 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] monkey_patch = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] monkey_patch_modules = [] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] my_ip = 192.168.122.103 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] no_snapshot_gb_quota = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] num_iser_scan_tries = 3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] num_shell_tries = 3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] num_volume_device_scan_tries = 3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] nvmeof_conn_info_version = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] nvmet_ns_id = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] nvmet_port_id = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] osapi_max_limit = 1000 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] osapi_volume_ext_list = [] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] osapi_volume_listen = 0.0.0.0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] osapi_volume_listen_port = 8776 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] osapi_volume_use_ssl = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] osapi_volume_workers = 2 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] per_volume_size_limit = -1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] periodic_fuzzy_delay = 60 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] periodic_interval = 60 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] project_id_regex = [0-9a-f\-]+ {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] public_endpoint = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] publish_errors = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] quota_backup_gigabytes = 1000 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] quota_backups = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] quota_gigabytes = 1000 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] quota_groups = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] quota_snapshots = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] quota_volumes = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] rate_limit_burst = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] rate_limit_except_level = CRITICAL {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] rate_limit_interval = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] reinit_driver_count = 3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] replication_device = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] report_discard_supported = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] report_interval = 120 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] reservation_clean_interval = 86400 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] reservation_expire = 86400 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] reserved_image_namespaces = [] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] reserved_percentage = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] rpc_response_timeout = 120 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] run_external_periodic_tasks = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] scst_target_driver = iscsi {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] scst_target_iqn_name = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] service_down_time = 720 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] shell_completion = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] snapshot_name_template = snapshot-%s {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] split_loggers = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] state_path = /opt/stack/data/cinder {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] storage_availability_zone = nova {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] storage_protocol = iSCSI {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] syslog_log_facility = LOG_USER {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] target_helper = lioadm {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] target_ip_address = 192.168.122.103 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] target_port = 3260 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] target_protocol = iscsi {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] target_secondary_ip_addresses = [] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] trace_flags = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] transfer_api_class = cinder.transfer.api.API {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] transport_url = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] until_refresh = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] use_chap_auth = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] use_default_quota_class = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] use_journal = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] use_json = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] use_multipath_for_image_xfer = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] use_stderr = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] use_syslog = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] verify_glance_signatures = enabled {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_api_class = cinder.volume.api.API {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_backend_name = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_clear = zero {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_clear_ionice = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_clear_size = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83305) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 14:35:25 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.quobyte [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 14:35:25 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.quobyte [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_copy_bps_limit = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_dd_blocksize = 1M {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_name_template = volume-%s {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_service_inithost_offload = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Running cmd (subprocess): mount.quobyte {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:35:25 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volume_usage_audit_period = month {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] zoning_mode = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_concurrency.disable_process_locking = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.admin_password = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.admin_token = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.admin_user = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.auth_admin_prefix = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.auth_port = 35357 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.auth_protocol = https {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.auth_section = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.auth_type = password {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.auth_uri = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.auth_version = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.cache = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.certfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.delay_auth_decision = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.http_connect_timeout = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.identity_uri = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.include_service_catalog = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.insecure = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.interface = public {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.keyfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_password = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcache_username = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.region_name = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.service_token_roles_required = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.service_type = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.token_cache_time = 300 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.103/identity {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.backend = dogpile.cache.null {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.backend_argument = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.backend_expiration_time = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.config_prefix = cache.oslo {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.debug_cache_backend = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.enable_retry_client = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.enable_socket_keepalive = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.enabled = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.enforce_fips_mode = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.expiration_time = 600 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.hashclient_retry_attempts = 2 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.memcache_dead_retry = 300 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.memcache_pool_maxsize = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.memcache_sasl_enabled = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.password = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.proxies = [] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.redis_db = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.redis_sentinel_service_name = mymaster {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.redis_server = localhost:6379 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.retry_attempts = 2 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.retry_delay = 0.0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.socket_keepalive_count = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.socket_keepalive_idle = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.socket_keepalive_interval = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.socket_timeout = 1.0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.tls_allowed_ciphers = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.tls_cafile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.tls_certfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.tls_enabled = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.tls_keyfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cache.username = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] coordination.backend_url = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.asyncio_connection = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.asyncio_slave_connection = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.backend = sqlalchemy {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.connection = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.connection_debug = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.connection_parameters = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.connection_recycle_time = 3600 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.connection_trace = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.db_inc_retry_interval = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.db_max_retries = 20 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.db_max_retry_interval = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.db_retry_interval = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack quobyte-client[83315]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 14:35:26 devstack quobyte-client[83315]: Invalid parameters found, error: missing mount point. Apr 16 14:35:26 devstack quobyte-client[83315]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 14:35:26 devstack quobyte-client[83315]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.max_overflow = 50 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.max_pool_size = 5 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.max_retries = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.mysql_wsrep_sync_wait = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] CMD "mount.quobyte" returned: 1 in 0.048s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.pool_timeout = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.retry_interval = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.slave_connection = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.sqlite_synchronous = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.synchronous_reader = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] database.use_db_reconnect = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler.connection_string = messaging:// {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler.enabled = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler.es_doc_type = notification {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler.es_scroll_size = 10000 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler.es_scroll_time = 2m {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler.filter_error_trace = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler.hmac_keys = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler.sentinel_service_name = mymaster {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler.socket_timeout = 0.1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler.trace_requests = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler.trace_sqlalchemy = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler_jaeger.process_tags = {} {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler_jaeger.service_name_prefix = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] profiler_otlp.service_name_prefix = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_policy.enforce_new_defaults = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: WARNING oslo_config.cfg [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_policy.enforce_scope = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_policy.policy_default_rule = default {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_policy.policy_file = policy.yaml {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_policy.remote_timeout = 60.0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] privsep_osbrick.group = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] privsep_osbrick.helper_command = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] privsep_osbrick.user = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cinder_sys_admin.group = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cinder_sys_admin.helper_command = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] cinder_sys_admin.user = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] service_user.auth_section = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack sudo[83316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] service_user.auth_type = password {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] service_user.cafile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack sudo[83316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] service_user.certfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] service_user.collect_timing = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] service_user.insecure = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] service_user.keyfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] service_user.send_service_user_token = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] service_user.split_loggers = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] service_user.timeout = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance.auth_section = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance.auth_type = password {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance.certfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance.collect_timing = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance.insecure = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance.keyfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance.region_name = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance.split_loggers = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] glance.timeout = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.backend_availability_zone = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.chap_password = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.chap_username = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.disk_geometry = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.driver_client_cert = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.driver_client_cert_key = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.driver_data_namespace = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.driver_use_ssl = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.enable_unsupported_driver = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.extra_capabilities = {} {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.filter_function = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.goodness_function = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.iscsi_target_flags = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.iscsi_write_cache = on {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.iser_helper = tgtadm {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.iser_ip_address = 192.168.122.103 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.iser_port = 3260 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nas_host = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nas_login = admin {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nas_mount_options = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nas_password = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nas_private_key = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nas_share_path = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nas_ssh_port = 22 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.num_shell_tries = 3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.nvmet_port_id = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.quobyte_client_cfg = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.quobyte_volume_url = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.replication_device = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.report_discard_supported = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.reserved_percentage = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.scst_target_driver = iscsi {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.scst_target_iqn_name = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.storage_protocol = iSCSI {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.target_helper = tgtadm {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.target_ip_address = 192.168.122.103 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.target_port = 3260 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.target_protocol = iscsi {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.trace_flags = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.unique_fqdn_network = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.use_chap_auth = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.volume_backend_name = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.volume_clear = zero {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.volume_clear_ionice = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.volume_clear_size = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_reports.file_event_handler = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_reports.log_dir = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.backend_availability_zone = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.backend_host = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.chap_password = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.chap_username = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.chiscsi_conf = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.disk_geometry = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.driver_client_cert = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.driver_client_cert_key = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.driver_data_namespace = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.driver_use_ssl = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.extra_capabilities = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.filter_function = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.goodness_function = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.iscsi_target_flags = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.iscsi_write_cache = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.iser_helper = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.iser_ip_address = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.iser_port = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.iser_target_prefix = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nas_host = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nas_login = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nas_mount_options = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nas_password = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nas_private_key = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nas_share_path = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nas_ssh_port = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.num_shell_tries = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nvmet_ns_id = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.nvmet_port_id = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.replication_device = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.report_discard_supported = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.reserved_percentage = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.scst_target_driver = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.storage_protocol = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.target_helper = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.target_ip_address = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.target_port = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.target_prefix = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.target_protocol = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.trace_flags = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.unique_fqdn_network = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.use_chap_auth = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.volume_clear = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.volume_clear_ionice = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.volume_clear_size = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] QuobyteHD.volumes_dir = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.ssl = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.ssl_version = {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_notifications.driver = [] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_notifications.retry = -1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] oslo_messaging_notifications.transport_url = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] key_manager.fixed_key = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.barbican_api_version = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.barbican_endpoint = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.barbican_endpoint_type = public {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.barbican_region_name = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.cafile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.certfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.collect_timing = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.insecure = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.keyfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.number_of_retries = 60 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.retry_delay = 1 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.send_service_user_token = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.split_loggers = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.timeout = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.verify_ssl = True {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican.verify_ssl_path = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican_service_user.auth_section = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican_service_user.auth_type = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican_service_user.cafile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican_service_user.certfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican_service_user.collect_timing = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican_service_user.insecure = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican_service_user.keyfile = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican_service_user.split_loggers = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] barbican_service_user.timeout = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vault.approle_role_id = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vault.approle_secret_id = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vault.kv_mountpoint = secret {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vault.kv_path = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vault.kv_version = 2 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vault.namespace = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vault.root_token_id = **** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vault.ssl_ca_crt_file = None {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vault.timeout = 60.0 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vault.use_ssl = False {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 14:35:26 devstack cinder-volume[83091]: DEBUG oslo_service.backend._eventlet.service [None req-18493c53-2db7-4094-bcbd-d4af927d246d None None] ******************************************************************************** {{(pid=83091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 14:35:26 devstack sudo[83316]: pam_unix(sudo:session): session closed for user root Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.427s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:35:26 devstack cinder-volume[83305]: INFO cinder.volume.driver [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Driver hasn't implemented _init_vendor_properties() Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG cinder.volume.driver [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83305) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_db.sqlalchemy.engines [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83305) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writer thread running {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG cinder.db.sqlalchemy.api [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Building query based on filter {{(pid=83305) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83305) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:35:26 devstack cinder-volume[83305]: INFO cinder.keymgr.migration [None req-70ee29ac-88c7-43a4-98d4-61a6a6dbcb9e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 14:35:26 devstack sudo[83332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:35:26 devstack sudo[83332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:35:26 devstack sudo[83332]: pam_unix(sudo:session): session closed for user root Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.417s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:35:26 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Driver initialization completed successfully. Apr 16 14:35:26 devstack cinder-volume[83305]: INFO cinder.manager [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Initiating service 3 cleanup Apr 16 14:35:26 devstack cinder-volume[83305]: INFO cinder.manager [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Service 3 cleanup completed. Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG cinder.service [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Creating RPC server for service cinder-volume {{(pid=83305) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 14:35:26 devstack cinder-volume[83305]: DEBUG cinder.service [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83305) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 14:35:27 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 14:35:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:35:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:35:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:35:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:35:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:35:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:35:27 devstack sudo[83336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:35:27 devstack sudo[83336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:35:27 devstack sudo[83336]: pam_unix(sudo:session): session closed for user root Apr 16 14:35:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.434s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:35:27 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e1d4ac13-a926-431b-9080-6d426f109aba None None] Driver post RPC initialization completed successfully. Apr 16 14:35:35 devstack cinder-volume[83091]: DEBUG dbcounter [-] [83091] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83091) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:35:36 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:35:37 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=2 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:36:33 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:36:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Flow 'volume_create_manager' (fad55f62-a372-438b-8f0e-645a202daedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fba137-20b1-4abf-b67b-f4a996c52916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fba137-20b1-4abf-b67b-f4a996c52916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-957001220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a04415b-60a7-4d2f-8cf6-5acd3a38309d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f9805996e8412390ae2de868b6ffba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:36:34Z,use_quota=True,user_id='abde012afed0416280add445f377de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469d15f9-88b7-4677-a3d2-d0ca14dbb57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469d15f9-88b7-4677-a3d2-d0ca14dbb57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddec53c2-1d0c-40c7-8b09-9395c34392ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddec53c2-1d0c-40c7-8b09-9395c34392ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a04415b-60a7-4d2f-8cf6-5acd3a38309d', 'volume_name': 'volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca5c358-09f8-4563-8c24-85a13630b940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca5c358-09f8-4563-8c24-85a13630b940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c827cde-62dc-4584-8c7f-9116b9caa1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:34 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Volume 6a04415b-60a7-4d2f-8cf6-5acd3a38309d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d', 'volume_size': 1} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-957001220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a04415b-60a7-4d2f-8cf6-5acd3a38309d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f9805996e8412390ae2de868b6ffba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:36:34Z,use_quota=True,user_id='abde012afed0416280add445f377de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Creating volume 6a04415b-60a7-4d2f-8cf6-5acd3a38309d {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:36:34 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:36:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:36:34 devstack sudo[83903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d 1073741824 Apr 16 14:36:34 devstack sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:36:36 devstack sudo[83903]: pam_unix(sudo:session): session closed for user root Apr 16 14:36:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d 1073741824" returned: 0 in 2.259s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:36:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:36:36 devstack sudo[84226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d Apr 16 14:36:36 devstack sudo[84226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:36:37 devstack sudo[84226]: pam_unix(sudo:session): session closed for user root Apr 16 14:36:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d" returned: 0 in 0.958s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:36:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] <== create_volume: return (3317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:36:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.328s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:36:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c827cde-62dc-4584-8c7f-9116b9caa1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d063307-6f4f-4ae0-bd58-65b12aa993f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:37 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Volume volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d (6a04415b-60a7-4d2f-8cf6-5acd3a38309d): created successfully Apr 16 14:36:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d063307-6f4f-4ae0-bd58-65b12aa993f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Flow 'volume_create_manager' (fad55f62-a372-438b-8f0e-645a202daedf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:36:37 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-4564be03-ce9a-4d07-9e83-1bc5bd7e2c8d tempest-VolumesAdminNegativeTest-1215805981 None] Created volume successfully. Apr 16 14:36:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Acquiring lock "cinder-6a04415b-60a7-4d2f-8cf6-5acd3a38309d-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:36:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Lock "cinder-6a04415b-60a7-4d2f-8cf6-5acd3a38309d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:36:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Acquiring lock "cinder-quobyte-6a04415b-60a7-4d2f-8cf6-5acd3a38309d" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:36:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Lock "cinder-quobyte-6a04415b-60a7-4d2f-8cf6-5acd3a38309d" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:36:39 devstack cinder-volume[83305]: INFO oslo.privsep.daemon [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpm8oydr9c/privsep.sock'] Apr 16 14:36:39 devstack sudo[84256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpm8oydr9c/privsep.sock Apr 16 14:36:39 devstack sudo[84256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:36:40 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 16 14:36:40 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 14:36:40 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 14:36:40 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 14:36:40 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 14:36:40 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 14:36:40 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 14:36:40 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 14:36:40 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 16 14:36:41 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 16 14:36:41 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 14:36:41 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 14:36:41 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 14:36:41 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 14:36:41 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 14:36:41 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 14:36:41 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 14:36:41 devstack cinder-volume[83305]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 16 14:36:42 devstack sudo[84256]: pam_unix(sudo:session): session closed for user root Apr 16 14:36:42 devstack cinder-volume[83305]: INFO oslo.privsep.daemon [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Spawned new privsep daemon via rootwrap Apr 16 14:36:42 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Accepted privsep connection to /tmp/tmpm8oydr9c/privsep.sock {{(pid=83305) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 16 14:36:42 devstack cinder-volume[83305]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 16 14:36:42 devstack cinder-volume[83305]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 16 14:36:42 devstack cinder-volume[83305]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 16 14:36:42 devstack cinder-volume[83305]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84284 Apr 16 14:36:42 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa6f334-b7b0-47db-94f2-be6c4a4ccb17]: (2,) {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:36:42 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2823768-f0c2-4d0e-9860-c27248a2fe17]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:36:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:36:43 devstack sudo[84292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d Apr 16 14:36:43 devstack sudo[84292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:36:44 devstack sudo[84292]: pam_unix(sudo:session): session closed for user root Apr 16 14:36:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d" returned: 0 in 1.219s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:36:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:36:44 devstack sudo[84327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d Apr 16 14:36:44 devstack sudo[84327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:36:45 devstack sudo[84327]: pam_unix(sudo:session): session closed for user root Apr 16 14:36:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6a04415b-60a7-4d2f-8cf6-5acd3a38309d" returned: 0 in 1.091s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:36:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Lock "cinder-quobyte-6a04415b-60a7-4d2f-8cf6-5acd3a38309d" released by "delete_volume" :: held 5.413s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:36:45 devstack cinder-volume[83305]: WARNING cinder.quota [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:36:45 devstack cinder-volume[83305]: WARNING cinder.quota [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:36:45 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Created reservations ['c35f1022-eabd-4521-99e5-986782cd3ca3', 'cecf4df1-6278-4553-b7c9-05c8dc866013', 'c0da0d13-6f76-4b09-bc92-b2eb461a157a', '254f4033-a256-4764-9e70-5168fde89d5e'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:36:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:36:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:36:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:36:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:36:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:36:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:36:45 devstack sudo[84335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:36:45 devstack sudo[84335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:36:46 devstack cinder-volume[83305]: DEBUG oslo_service.periodic_task [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:36:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:36:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:36:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:36:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:36:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:36:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:36:46 devstack sudo[84341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:36:46 devstack sudo[84341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:36:46 devstack sudo[84335]: pam_unix(sudo:session): session closed for user root Apr 16 14:36:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 1.306s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:36:46 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:36:46 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Deleted volume successfully. Apr 16 14:36:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eff8f2-5d1b-4139-9f5b-f937f3a32e6d tempest-VolumesAdminNegativeTest-1215805981 None] Lock "cinder-6a04415b-60a7-4d2f-8cf6-5acd3a38309d-delete_volume" released by "delete_volume" :: held 7.219s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Flow 'volume_create_manager' (0478d179-ed16-48bb-b66f-e89718066907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d293f877-5044-4456-9242-34a433ad33df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d293f877-5044-4456-9242-34a433ad33df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2138015141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d71c28f-1507-44de-b088-543e08c8c2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227a8a2bb0c44dd1996af107e3b6d8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:36:48Z,use_quota=True,user_id='795d1a2a088341cc8719cfe2ac580254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a64dc95-2b9f-471d-9333-1188f7cf7f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a64dc95-2b9f-471d-9333-1188f7cf7f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415edbf4-2c63-4628-a03d-9cc399154bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:48 devstack sudo[84341]: pam_unix(sudo:session): session closed for user root Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415edbf4-2c63-4628-a03d-9cc399154bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d71c28f-1507-44de-b088-543e08c8c2f7', 'volume_name': 'volume-8d71c28f-1507-44de-b088-543e08c8c2f7', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ed3eb4-d255-44dc-bc1c-ca10fd32eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ed3eb4-d255-44dc-bc1c-ca10fd32eea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f08bb4-a316-40d5-9da2-8c952d9e78ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:48 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Volume 8d71c28f-1507-44de-b088-543e08c8c2f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d71c28f-1507-44de-b088-543e08c8c2f7', 'volume_size': 1} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2138015141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d71c28f-1507-44de-b088-543e08c8c2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227a8a2bb0c44dd1996af107e3b6d8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:36:48Z,use_quota=True,user_id='795d1a2a088341cc8719cfe2ac580254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Creating volume 8d71c28f-1507-44de-b088-543e08c8c2f7 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:36:48 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 1.940s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:36:48 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:36:48 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7 1073741824 Apr 16 14:36:48 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:36:50 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Apr 16 14:36:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7 1073741824" returned: 0 in 2.051s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:36:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:36:50 devstack sudo[84432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7 Apr 16 14:36:50 devstack sudo[84432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:36:51 devstack sudo[84432]: pam_unix(sudo:session): session closed for user root Apr 16 14:36:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7" returned: 0 in 1.033s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:36:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] <== create_volume: return (3155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:36:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.163s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:36:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f08bb4-a316-40d5-9da2-8c952d9e78ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d71c28f-1507-44de-b088-543e08c8c2f7', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e760581-1703-44bb-9c99-8967b70f44cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:36:51 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Volume volume-8d71c28f-1507-44de-b088-543e08c8c2f7 (8d71c28f-1507-44de-b088-543e08c8c2f7): created successfully Apr 16 14:36:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e760581-1703-44bb-9c99-8967b70f44cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:36:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Flow 'volume_create_manager' (0478d179-ed16-48bb-b66f-e89718066907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:36:51 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-747ca11f-d6e1-4bb5-b12e-bee77a1f1672 tempest-ServerRescueNegativeTestJSON-1675716907 None] Created volume successfully. Apr 16 14:37:01 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=8,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:37:01 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:DELETE=3,cinder:INSERT=3 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Flow 'volume_create_manager' (b106ab56-007c-4ad5-bfc7-98654a6f87d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2983ac7f-8244-4b3f-9e39-96f7634d0527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2983ac7f-8244-4b3f-9e39-96f7634d0527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1795438877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bd7b33-6b5c-44c7-9bd1-f4599f59f223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf61bcd0bf1c4359ad0bce8dd590035c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:03Z,use_quota=True,user_id='0fc2bcd355fd43e2933960cbc582ca48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8599e2fb-bbe6-4be5-a91f-52dffec59732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8599e2fb-bbe6-4be5-a91f-52dffec59732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e1ffda-8e7d-4f23-b6c3-60d482f8348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e1ffda-8e7d-4f23-b6c3-60d482f8348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1bd7b33-6b5c-44c7-9bd1-f4599f59f223', 'volume_name': 'volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ec9779-a6a3-4e78-80ba-a57ca7417219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ec9779-a6a3-4e78-80ba-a57ca7417219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b184e1-a587-4a4a-b160-718c90836279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:03 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Volume a1bd7b33-6b5c-44c7-9bd1-f4599f59f223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223', 'volume_size': 1} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1795438877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bd7b33-6b5c-44c7-9bd1-f4599f59f223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf61bcd0bf1c4359ad0bce8dd590035c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:03Z,use_quota=True,user_id='0fc2bcd355fd43e2933960cbc582ca48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Creating volume a1bd7b33-6b5c-44c7-9bd1-f4599f59f223 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:37:03 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:37:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:03 devstack sudo[84611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223 1073741824 Apr 16 14:37:03 devstack sudo[84611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Flow 'volume_create_manager' (4288324f-9edf-4b76-b1e9-b4e7bb3e13e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a060eb0-4875-4586-bef9-5f0eb4c28a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a060eb0-4875-4586-bef9-5f0eb4c28a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1384684748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7d1264-1185-4c93-8eb2-76c5a58c0ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d550c8bdd4af4e6ba92aab38588c4f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:05Z,use_quota=True,user_id='09e65d1605974ec89236c59cb3c5a7b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10546b4-b155-4a04-9bc9-95ac7ea164a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10546b4-b155-4a04-9bc9-95ac7ea164a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18da25b8-b42a-47ea-be38-011c3869324a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18da25b8-b42a-47ea-be38-011c3869324a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b7d1264-1185-4c93-8eb2-76c5a58c0ca4', 'volume_name': 'volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d18b81b-a7be-42c3-afa5-f4e00978d2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d18b81b-a7be-42c3-afa5-f4e00978d2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5cfb76-c533-4b96-9374-31a9f93ffa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:04 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Volume 0b7d1264-1185-4c93-8eb2-76c5a58c0ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4', 'volume_size': 1} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:04 devstack sudo[84611]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223 1073741824" returned: 0 in 1.089s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:04 devstack sudo[84617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223 Apr 16 14:37:04 devstack sudo[84617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:05 devstack sudo[84617]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223" returned: 0 in 0.802s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1384684748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7d1264-1185-4c93-8eb2-76c5a58c0ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d550c8bdd4af4e6ba92aab38588c4f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:05Z,use_quota=True,user_id='09e65d1605974ec89236c59cb3c5a7b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Creating volume 0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:37:05 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b184e1-a587-4a4a-b160-718c90836279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:05 devstack sudo[84629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 1073741824 Apr 16 14:37:05 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b819d27-cb66-49fa-aebe-b80fe8d46952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:05 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Volume volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223 (a1bd7b33-6b5c-44c7-9bd1-f4599f59f223): created successfully Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b819d27-cb66-49fa-aebe-b80fe8d46952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Flow 'volume_create_manager' (b106ab56-007c-4ad5-bfc7-98654a6f87d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:05 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-55a8a2f9-de80-476b-9074-959812da575e tempest-ServersNegativeTestJSON-1324825410 None] Created volume successfully. Apr 16 14:37:07 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 1073741824" returned: 0 in 1.383s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:07 devstack sudo[84657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 Apr 16 14:37:07 devstack sudo[84657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:08 devstack sudo[84657]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4" returned: 0 in 1.026s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] <== create_volume: return (2479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:37:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.484s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5cfb76-c533-4b96-9374-31a9f93ffa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea61066a-288b-47e9-ba8e-6022b849fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:08 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Volume volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 (0b7d1264-1185-4c93-8eb2-76c5a58c0ca4): created successfully Apr 16 14:37:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea61066a-288b-47e9-ba8e-6022b849fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Flow 'volume_create_manager' (4288324f-9edf-4b76-b1e9-b4e7bb3e13e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:08 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-507d9e8b-ceda-419c-a6a0-9488c06ae859 tempest-DeleteServersTestJSON-2137379734 None] Created volume successfully. Apr 16 14:37:09 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:37:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Flow 'volume_create_manager' (172b1ec5-0da7-46b8-a542-2df0a33fee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d13f73-2a64-4025-bc2b-69723656af60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d13f73-2a64-4025-bc2b-69723656af60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1779474721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62fd0161-1d5f-4dd5-b58a-48936e0e64d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf61bcd0bf1c4359ad0bce8dd590035c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:10Z,use_quota=True,user_id='0fc2bcd355fd43e2933960cbc582ca48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4dc590-baf9-48c0-9181-1f75e36aaea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4dc590-baf9-48c0-9181-1f75e36aaea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548aefc3-a688-4b91-857f-647099c2a2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548aefc3-a688-4b91-857f-647099c2a2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62fd0161-1d5f-4dd5-b58a-48936e0e64d5', 'volume_name': 'volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1caf6a-8bcd-48ce-823c-a996790cd443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1caf6a-8bcd-48ce-823c-a996790cd443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c931ea86-1104-448b-b952-bd81c0e99c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:10 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Volume 62fd0161-1d5f-4dd5-b58a-48936e0e64d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5', 'volume_size': 1} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1779474721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62fd0161-1d5f-4dd5-b58a-48936e0e64d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf61bcd0bf1c4359ad0bce8dd590035c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:10Z,use_quota=True,user_id='0fc2bcd355fd43e2933960cbc582ca48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Creating volume 62fd0161-1d5f-4dd5-b58a-48936e0e64d5 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:37:10 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:10 devstack sudo[84716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5 1073741824 Apr 16 14:37:10 devstack sudo[84716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Acquiring lock "cinder-8d71c28f-1507-44de-b088-543e08c8c2f7-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Lock "cinder-8d71c28f-1507-44de-b088-543e08c8c2f7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Acquiring lock "cinder-quobyte-8d71c28f-1507-44de-b088-543e08c8c2f7" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Lock "cinder-quobyte-8d71c28f-1507-44de-b088-543e08c8c2f7" acquired by "delete_volume" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c496bad9-d53e-4a78-b369-2f62bc61c939]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:10 devstack sudo[84719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7 Apr 16 14:37:10 devstack sudo[84719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:11 devstack sudo[84716]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5 1073741824" returned: 0 in 1.341s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:11 devstack sudo[84719]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7" returned: 0 in 0.852s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:11 devstack sudo[84727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7 Apr 16 14:37:11 devstack sudo[84727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:11 devstack sudo[84731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5 Apr 16 14:37:11 devstack sudo[84731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:12 devstack sudo[84727]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8d71c28f-1507-44de-b088-543e08c8c2f7" returned: 0 in 1.177s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Lock "cinder-quobyte-8d71c28f-1507-44de-b088-543e08c8c2f7" released by "delete_volume" :: held 2.125s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:12 devstack sudo[84731]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5" returned: 0 in 1.201s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] <== create_volume: return (2655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.658s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c931ea86-1104-448b-b952-bd81c0e99c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1cb472-844e-4000-bfd7-a118066ba5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Created reservations ['ed832c97-6e94-4cc7-8c1c-4bbfb78527cc', 'a5804679-7b4d-4ee1-9053-4dda5b384eda', 'd0c0e701-d95a-489e-9a57-8f3d44bbbaff', '913fb82d-52e9-4859-8afb-7ba23e1c899b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:12 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Volume volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5 (62fd0161-1d5f-4dd5-b58a-48936e0e64d5): created successfully Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1cb472-844e-4000-bfd7-a118066ba5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Flow 'volume_create_manager' (172b1ec5-0da7-46b8-a542-2df0a33fee79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:12 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-746d8898-0001-4843-8d39-3e6d3ad155b1 tempest-ServersNegativeTestJSON-1324825410 None] Created volume successfully. Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:12 devstack sudo[84739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:37:12 devstack sudo[84739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:13 devstack sudo[84739]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Acquiring lock "cinder-62fd0161-1d5f-4dd5-b58a-48936e0e64d5-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.840s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:13 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:37:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Lock "cinder-62fd0161-1d5f-4dd5-b58a-48936e0e64d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:13 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Deleted volume successfully. Apr 16 14:37:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3219f686-fd14-41ed-b21c-b893a9e54d57 tempest-ServerRescueNegativeTestJSON-1675716907 None] Lock "cinder-8d71c28f-1507-44de-b088-543e08c8c2f7-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Acquiring lock "cinder-quobyte-62fd0161-1d5f-4dd5-b58a-48936e0e64d5" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Lock "cinder-quobyte-62fd0161-1d5f-4dd5-b58a-48936e0e64d5" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:13 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c01e3c-87c1-4937-b36c-c402a26c6ca6]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:14 devstack sudo[84746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5 Apr 16 14:37:14 devstack sudo[84746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:15 devstack sudo[84746]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5" returned: 0 in 1.485s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:15 devstack sudo[84761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5 Apr 16 14:37:15 devstack sudo[84761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:16 devstack cinder-volume[83305]: WARNING py.warnings [req-7e50fb16-c869-4bbd-afdf-24f9df680bd9 req-06b8c1b7-2728-4e9d-95fd-ca112ff0eb5e tempest-DeleteServersTestJSON-2137379734 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 16 14:37:16 devstack cinder-volume[83305]: .first() Apr 16 14:37:16 devstack cinder-volume[83305]: Apr 16 14:37:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-7e50fb16-c869-4bbd-afdf-24f9df680bd9 req-06b8c1b7-2728-4e9d-95fd-ca112ff0eb5e tempest-DeleteServersTestJSON-2137379734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-7e50fb16-c869-4bbd-afdf-24f9df680bd9 req-06b8c1b7-2728-4e9d-95fd-ca112ff0eb5e tempest-DeleteServersTestJSON-2137379734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:16 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[538d4e9c-bab2-4551-b135-4ea7245ec582]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-7e50fb16-c869-4bbd-afdf-24f9df680bd9 req-06b8c1b7-2728-4e9d-95fd-ca112ff0eb5e tempest-DeleteServersTestJSON-2137379734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:16 devstack sudo[84801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 Apr 16 14:37:16 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:16 devstack sudo[84761]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-62fd0161-1d5f-4dd5-b58a-48936e0e64d5" returned: 0 in 1.423s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Lock "cinder-quobyte-62fd0161-1d5f-4dd5-b58a-48936e0e64d5" released by "delete_volume" :: held 3.025s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:16 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Created reservations ['16e4fffd-43d1-4358-8857-67998a8406fb', '21d737ec-20f7-48d1-895a-3bfe699fbb32', '000fc30e-abd6-4b62-bea7-e8a2c82db80d', '7f92ab93-a9e9-4669-8758-8eb67b843694'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:17 devstack sudo[84803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:37:17 devstack sudo[84803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Acquiring lock "cinder-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Lock "cinder-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Acquiring lock "cinder-quobyte-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Lock "cinder-quobyte-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223" acquired by "delete_volume" :: waited 0.041s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9f6db0-2a03-4159-b8fa-5348c5024f02]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:17 devstack sudo[84805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223 Apr 16 14:37:17 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:18 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-7e50fb16-c869-4bbd-afdf-24f9df680bd9 req-06b8c1b7-2728-4e9d-95fd-ca112ff0eb5e tempest-DeleteServersTestJSON-2137379734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4" returned: 0 in 1.634s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-7e50fb16-c869-4bbd-afdf-24f9df680bd9 req-06b8c1b7-2728-4e9d-95fd-ca112ff0eb5e tempest-DeleteServersTestJSON-2137379734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.675s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:18 devstack sudo[84803]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 1.353s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:18 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:37:18 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Deleted volume successfully. Apr 16 14:37:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-7e50fb16-c869-4bbd-afdf-24f9df680bd9 req-06b8c1b7-2728-4e9d-95fd-ca112ff0eb5e tempest-DeleteServersTestJSON-2137379734 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5', 'name': 'volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fea1490-a3ee-4361-b109-b497b4010891', 'enforce_multipath': True} {{(pid=83305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 14:37:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fd030ac8-29a4-4d7b-9692-9a5b556b1259 tempest-ServersNegativeTestJSON-1324825410 None] Lock "cinder-62fd0161-1d5f-4dd5-b58a-48936e0e64d5-delete_volume" released by "delete_volume" :: held 4.720s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:18 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-7e50fb16-c869-4bbd-afdf-24f9df680bd9 req-06b8c1b7-2728-4e9d-95fd-ca112ff0eb5e tempest-DeleteServersTestJSON-2137379734 None] attachment_update completed successfully. Apr 16 14:37:18 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223" returned: 0 in 1.422s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:18 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223 Apr 16 14:37:18 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:19 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223" returned: 0 in 0.952s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Lock "cinder-quobyte-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223" released by "delete_volume" :: held 2.433s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:19 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Created reservations ['ac442624-3a00-4957-8296-e658d6f0c7c8', '37c1c711-84e2-4ec5-a151-140ffdceef32', 'db01319c-ea42-478b-8707-7f573987e933', '173a9b03-3806-428e-9200-e56bcf200f44'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:19 devstack sudo[84887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:37:19 devstack sudo[84887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:20 devstack sudo[84887]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.631s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:20 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:37:20 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Deleted volume successfully. Apr 16 14:37:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-43f15730-1c3a-4972-81c1-6dcf6f240ab1 tempest-ServersNegativeTestJSON-1324825410 None] Lock "cinder-a1bd7b33-6b5c-44c7-9bd1-f4599f59f223-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Flow 'volume_create_manager' (70fecd6b-8bc7-4438-9efb-6bc66e695ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bdaf2d-cbb3-4286-a0c4-9d331753bebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bdaf2d-cbb3-4286-a0c4-9d331753bebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-668298916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8082ec1d-2a2b-4405-b582-90bf266be596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='096a45d9a8124604948a62b650e32933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:23Z,use_quota=True,user_id='8f2bb859f98841febcc150778c097a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f604a497-95b4-4929-8428-38b4ba3405ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f604a497-95b4-4929-8428-38b4ba3405ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6989000e-89e4-458a-a0f6-f5d9103c04b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6989000e-89e4-458a-a0f6-f5d9103c04b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8082ec1d-2a2b-4405-b582-90bf266be596', 'volume_name': 'volume-8082ec1d-2a2b-4405-b582-90bf266be596', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01991f5-a1d8-4c05-93dc-edae67180b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01991f5-a1d8-4c05-93dc-edae67180b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da884d6f-880e-4ed2-9beb-11dd4bb3a4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:23 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Volume 8082ec1d-2a2b-4405-b582-90bf266be596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8082ec1d-2a2b-4405-b582-90bf266be596', 'volume_size': 1} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-668298916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8082ec1d-2a2b-4405-b582-90bf266be596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='096a45d9a8124604948a62b650e32933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:23Z,use_quota=True,user_id='8f2bb859f98841febcc150778c097a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Creating volume 8082ec1d-2a2b-4405-b582-90bf266be596 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:37:23 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:37:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:23 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 1073741824 Apr 16 14:37:23 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:24 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 1073741824" returned: 0 in 0.909s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:24 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 Apr 16 14:37:24 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:25 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596" returned: 0 in 0.570s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da884d6f-880e-4ed2-9beb-11dd4bb3a4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8082ec1d-2a2b-4405-b582-90bf266be596', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89fe73a-880b-4ea1-9fed-dd301cab0a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:25 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Volume volume-8082ec1d-2a2b-4405-b582-90bf266be596 (8082ec1d-2a2b-4405-b582-90bf266be596): created successfully Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89fe73a-880b-4ea1-9fed-dd301cab0a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Flow 'volume_create_manager' (70fecd6b-8bc7-4438-9efb-6bc66e695ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:25 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-748b616a-3f96-4e1b-8b4c-be0bf22f2da1 req-69a0fe08-713e-406d-b3f4-a326dfd15211 tempest-VolumesSnapshotsTestJSON-1629344519 None] Created volume successfully. Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] Creating offline snapshot 26ac225f-4dab-49e3-aa1d-364bda32c4ad of volume 8082ec1d-2a2b-4405-b582-90bf266be596 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38bdd9f-e58a-468b-a532-7abdf8b302be]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:25 devstack sudo[85330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 Apr 16 14:37:25 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:26 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596" returned: 0 in 0.610s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:26 devstack sudo[85361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad 1G Apr 16 14:37:26 devstack sudo[85361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:27 devstack sudo[85361]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad 1G" returned: 0 in 0.538s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8082ec1d-2a2b-4405-b582-90bf266be596 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:27 devstack sudo[85368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8082ec1d-2a2b-4405-b582-90bf266be596 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad Apr 16 14:37:27 devstack sudo[85368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:27 devstack sudo[85368]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8082ec1d-2a2b-4405-b582-90bf266be596 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad" returned: 0 in 0.485s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:27 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad is being set with open permissions: ugo+rw Apr 16 14:37:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:27 devstack sudo[85373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad Apr 16 14:37:27 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:27 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-1b9ca60f-a94d-4d55-8704-95f52396983e req-641adc8b-f476-4de1-8b39-921b15db61b4 tempest-DeleteServersTestJSON-2137379734 None] Terminate volume connection completed successfully. Apr 16 14:37:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-1b9ca60f-a94d-4d55-8704-95f52396983e req-641adc8b-f476-4de1-8b39-921b15db61b4 tempest-DeleteServersTestJSON-2137379734 None] Deleting attachment 1fea1490-a3ee-4361-b109-b497b4010891. {{(pid=83305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 14:37:27 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad" returned: 0 in 0.438s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:27 devstack sudo[85376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.info Apr 16 14:37:27 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:28 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.info" returned: 0 in 0.505s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:28 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.info is being set with open permissions: ugo+rw Apr 16 14:37:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:28 devstack sudo[85380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.info Apr 16 14:37:28 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:28 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.info" returned: 0 in 0.442s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.069s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:28 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-21ebdb2b-4928-438b-8849-b937e8d14dde req-6ab6f546-20db-44be-8ad7-1c98d5c15b12 tempest-VolumesSnapshotsTestJSON-1629344519 None] Create snapshot completed successfully Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Acquiring lock "cinder-26ac225f-4dab-49e3-aa1d-364bda32c4ad-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "cinder-26ac225f-4dab-49e3-aa1d-364bda32c4ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Acquiring lock "cinder-quobyte-8082ec1d-2a2b-4405-b582-90bf266be596" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "cinder-quobyte-8082ec1d-2a2b-4405-b582-90bf266be596" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Acquiring lock "cinder-quobyte-26ac225f-4dab-49e3-aa1d-364bda32c4ad" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "cinder-quobyte-26ac225f-4dab-49e3-aa1d-364bda32c4ad" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Deleting offline snapshot 26ac225f-4dab-49e3-aa1d-364bda32c4ad of volume 8082ec1d-2a2b-4405-b582-90bf266be596 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] snapshot_file for this snap is: volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eec147-8479-4139-848e-8e495528c088]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:29 devstack sudo[85384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad Apr 16 14:37:29 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:29 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad" returned: 0 in 0.553s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8082ec1d-2a2b-4405-b582-90bf266be596(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2552face-6bb4-4a28-8fcc-6a0bfc18a703]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:29 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 Apr 16 14:37:29 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:30 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596" returned: 0 in 0.576s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:30 devstack sudo[85395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad Apr 16 14:37:30 devstack sudo[85395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:30 devstack sudo[85395]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad" returned: 0 in 0.518s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:31 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad Apr 16 14:37:31 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:31 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596.26ac225f-4dab-49e3-aa1d-364bda32c4ad" returned: 0 in 0.591s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "cinder-quobyte-26ac225f-4dab-49e3-aa1d-364bda32c4ad" released by "_delete_snapshot" :: held 2.297s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "cinder-quobyte-8082ec1d-2a2b-4405-b582-90bf266be596" released by "delete_snapshot" :: held 2.309s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:31 devstack cinder-volume[83305]: WARNING cinder.quota [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:37:31 devstack cinder-volume[83305]: DEBUG cinder.quota [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Created reservations ['9b3a4be6-f7e2-4632-b96f-915d5edfa3fc', '6da66c12-0401-4bc4-a73e-ab2adb62be65', 'e5e1e174-0125-4c87-9a5e-b64d8a961e5d', '57923a88-61a1-498e-bf93-45b2680cae40'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:31 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Delete snapshot completed successfully. Apr 16 14:37:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-89d557fc-a92b-428b-8dc0-656e94ec93a2 req-3b98441d-f28e-4f4e-83c0-fdd407405e8b tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "cinder-26ac225f-4dab-49e3-aa1d-364bda32c4ad-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Acquiring lock "cinder-8082ec1d-2a2b-4405-b582-90bf266be596-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "cinder-8082ec1d-2a2b-4405-b582-90bf266be596-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Acquiring lock "cinder-quobyte-8082ec1d-2a2b-4405-b582-90bf266be596" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "cinder-quobyte-8082ec1d-2a2b-4405-b582-90bf266be596" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:32 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a8a7d6-b625-4c0e-aaed-148e874c948e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:32 devstack sudo[85407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 Apr 16 14:37:32 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Acquiring lock "cinder-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Lock "cinder-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Acquiring lock "cinder-quobyte-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Lock "cinder-quobyte-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ec109d-16b8-4c84-b23c-421305ce3378]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:33 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596" returned: 0 in 0.739s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:33 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596 Apr 16 14:37:33 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:33 devstack sudo[85412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 Apr 16 14:37:33 devstack sudo[85412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:33 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8082ec1d-2a2b-4405-b582-90bf266be596" returned: 0 in 0.495s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:33 devstack sudo[85412]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4" returned: 0 in 0.541s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "cinder-quobyte-8082ec1d-2a2b-4405-b582-90bf266be596" released by "delete_volume" :: held 1.292s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:33 devstack sudo[85420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4 Apr 16 14:37:33 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG cinder.quota [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Created reservations ['9c32aa21-5a7a-40cb-b0eb-5a43571bf19e', 'f204846f-df53-428a-b7d5-972a8400da54', '08ce0833-52d1-404c-9f90-a5baa999f0e2', '6dafeef0-2760-4e6b-9343-a320750290ac'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:34 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:37:34 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:34 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4" returned: 0 in 0.546s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Lock "cinder-quobyte-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4" released by "delete_volume" :: held 1.122s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Created reservations ['d688e3b7-b256-47f0-b0da-528f2c33abac', 'fc61728b-e35a-45c0-b31c-9e1b17c691e1', 'c7047067-77e6-4b2f-a361-e91a4ed09b17', '1df51fa5-cc2f-4ad4-8890-5f0699e83a97'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:34 devstack sudo[85427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:37:34 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:34 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.572s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG cinder.manager [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:37:34 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Deleted volume successfully. Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-e0852bac-6c1d-483f-b7e8-2c233c794647 req-96ad9850-fc5c-4e92-b7ec-9c73c0da124e tempest-VolumesSnapshotsTestJSON-1629344519 None] Lock "cinder-8082ec1d-2a2b-4405-b582-90bf266be596-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:34 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.447s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:37:34 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Deleted volume successfully. Apr 16 14:37:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6ed60e52-bf56-4477-8074-dfc412c1d3d4 tempest-DeleteServersTestJSON-2137379734 None] Lock "cinder-0b7d1264-1185-4c93-8eb2-76c5a58c0ca4-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:35 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a6763bb-5bdd-4a16-a996-beed605f5bf7 tempest-BackendsCapabilitiesAdminTestsJSON-2146928184 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83305) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 14:37:36 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-7d04b4c5-fdb0-4120-a242-c599f8b2c6f4 tempest-GroupSnapshotsTest-1671665405 None] Group tempest-GroupSnapshotsTest-Group-912545763: creating Apr 16 14:37:36 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-7d04b4c5-fdb0-4120-a242-c599f8b2c6f4 tempest-GroupSnapshotsTest-1671665405 None] Group tempest-GroupSnapshotsTest-Group-912545763: created successfully Apr 16 14:37:36 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-7d04b4c5-fdb0-4120-a242-c599f8b2c6f4 tempest-GroupSnapshotsTest-1671665405 None] Create group completed successfully. Apr 16 14:37:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-72377dd7-7f5d-4837-a3be-beca6e416dc9 tempest-BackendsCapabilitiesAdminTestsJSON-2146928184 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83305) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Flow 'volume_create_manager' (78ad1860-d920-42ef-a057-e989a6fec029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84260e2-0d2e-4115-8e84-bbefc151f6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84260e2-0d2e-4115-8e84-bbefc151f6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1914381176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ed7fe245-2f59-49cb-89cf-de202c8ab863,host='devstack@QuobyteHD#QuobyteHD',id=bae80934-5180-40e0-a186-1cc630f3f29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d11e2b999664257800bb1433383c2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:38Z,use_quota=True,user_id='106cb889929143709282a85176be278a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(193b1dad-7657-4cff-ad16-14286b5fd888),volume_type_id=193b1dad-7657-4cff-ad16-14286b5fd888)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0278b6ce-144e-44b1-ad1c-6e51d8f6a064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0278b6ce-144e-44b1-ad1c-6e51d8f6a064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79235013-1185-4e10-a709-78c10808d81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79235013-1185-4e10-a709-78c10808d81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae80934-5180-40e0-a186-1cc630f3f29a', 'volume_name': 'volume-bae80934-5180-40e0-a186-1cc630f3f29a', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32faf57-176a-419e-b484-6df99b8c5e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32faf57-176a-419e-b484-6df99b8c5e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c90458-edc4-44b3-9751-d98a5eab8350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:37 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Volume bae80934-5180-40e0-a186-1cc630f3f29a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae80934-5180-40e0-a186-1cc630f3f29a', 'volume_size': 1} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ed7fe245-2f59-49cb-89cf-de202c8ab863,created_at=2026-04-16T12:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1914381176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ed7fe245-2f59-49cb-89cf-de202c8ab863,host='devstack@QuobyteHD#QuobyteHD',id=bae80934-5180-40e0-a186-1cc630f3f29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d11e2b999664257800bb1433383c2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:38Z,use_quota=True,user_id='106cb889929143709282a85176be278a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(193b1dad-7657-4cff-ad16-14286b5fd888),volume_type_id=193b1dad-7657-4cff-ad16-14286b5fd888)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Creating volume bae80934-5180-40e0-a186-1cc630f3f29a {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:37:37 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:37:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:37 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a 1073741824 Apr 16 14:37:37 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:37 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-357e0240-e2b2-44bf-a854-b32bc66e6e08 tempest-GroupSnapshotsV319Test-1983150223 None] Group tempest-GroupSnapshotsV319Test-Group-1570051090: creating Apr 16 14:37:37 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-357e0240-e2b2-44bf-a854-b32bc66e6e08 tempest-GroupSnapshotsV319Test-1983150223 None] Group tempest-GroupSnapshotsV319Test-Group-1570051090: created successfully Apr 16 14:37:37 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-357e0240-e2b2-44bf-a854-b32bc66e6e08 tempest-GroupSnapshotsV319Test-1983150223 None] Create group completed successfully. Apr 16 14:37:38 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a 1073741824" returned: 0 in 0.652s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:38 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a Apr 16 14:37:38 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:38 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a" returned: 0 in 0.521s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:37:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c90458-edc4-44b3-9751-d98a5eab8350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae80934-5180-40e0-a186-1cc630f3f29a', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d842cf-dfc3-4326-b623-54ae4e5404b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:38 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Volume volume-bae80934-5180-40e0-a186-1cc630f3f29a (bae80934-5180-40e0-a186-1cc630f3f29a): created successfully Apr 16 14:37:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d842cf-dfc3-4326-b623-54ae4e5404b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Flow 'volume_create_manager' (78ad1860-d920-42ef-a057-e989a6fec029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:38 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b17ccca3-a699-4e41-ab26-6ed2311e3b5b tempest-GroupSnapshotsTest-1671665405 None] Created volume successfully. Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Flow 'volume_create_manager' (81af405f-5c0a-4a5e-bc8b-3af05c881653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cc7251-1e86-4f1d-bd18-b87953db1b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cc7251-1e86-4f1d-bd18-b87953db1b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-738811909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51def8a4-8559-4b03-9e17-f38f313b9b66,host='devstack@QuobyteHD#QuobyteHD',id=e7ea743b-97f1-4b69-8ce9-74908b647367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7e762e67464c3eb4eeddbd60786d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:39Z,use_quota=True,user_id='1fa5ac0df3b34e1ca65c6fa351d09f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a77db5bc-4fe3-4fb5-ae57-6dcf0af2469f),volume_type_id=a77db5bc-4fe3-4fb5-ae57-6dcf0af2469f)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94f5c21-6fdf-4a51-b8a9-84324f12a07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94f5c21-6fdf-4a51-b8a9-84324f12a07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3560e66-eed5-435d-ad27-bea9dfd92839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3560e66-eed5-435d-ad27-bea9dfd92839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ea743b-97f1-4b69-8ce9-74908b647367', 'volume_name': 'volume-e7ea743b-97f1-4b69-8ce9-74908b647367', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bb523a-c653-4425-9ff8-26caad78972b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bb523a-c653-4425-9ff8-26caad78972b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc61213-d4df-4729-bbff-86d147f25227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:39 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Volume e7ea743b-97f1-4b69-8ce9-74908b647367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ea743b-97f1-4b69-8ce9-74908b647367', 'volume_size': 1} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51def8a4-8559-4b03-9e17-f38f313b9b66,created_at=2026-04-16T12:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-738811909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51def8a4-8559-4b03-9e17-f38f313b9b66,host='devstack@QuobyteHD#QuobyteHD',id=e7ea743b-97f1-4b69-8ce9-74908b647367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7e762e67464c3eb4eeddbd60786d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:39Z,use_quota=True,user_id='1fa5ac0df3b34e1ca65c6fa351d09f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a77db5bc-4fe3-4fb5-ae57-6dcf0af2469f),volume_type_id=a77db5bc-4fe3-4fb5-ae57-6dcf0af2469f)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Creating volume e7ea743b-97f1-4b69-8ce9-74908b647367 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:37:39 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:39 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 1073741824 Apr 16 14:37:39 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:39 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 1073741824" returned: 0 in 0.584s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:39 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 Apr 16 14:37:39 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:39 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] GroupSnapshot ca0434e6-2cfb-47da-a1f3-b27123438097: creating. Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] Group snapshot ca0434e6-2cfb-47da-a1f3-b27123438097: creating. {{(pid=83305) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:40 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367" returned: 0 in 0.488s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.341s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc61213-d4df-4729-bbff-86d147f25227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ea743b-97f1-4b69-8ce9-74908b647367', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26ab8a0-edf3-400a-8173-7a4e07db3697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] Creating offline snapshot b2b4e342-8f78-492d-b5fc-45ded38bd4dc of volume bae80934-5180-40e0-a186-1cc630f3f29a {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:37:40 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Volume volume-e7ea743b-97f1-4b69-8ce9-74908b647367 (e7ea743b-97f1-4b69-8ce9-74908b647367): created successfully Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26ab8a0-edf3-400a-8173-7a4e07db3697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Flow 'volume_create_manager' (81af405f-5c0a-4a5e-bc8b-3af05c881653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[677f0284-3879-4639-b62a-cbaed5623ee7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:40 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-2a5f6e95-5d95-4920-9b05-843ef46fd471 tempest-GroupSnapshotsV319Test-1983150223 None] Created volume successfully. Apr 16 14:37:40 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-565f7dc2-39d4-4919-85ef-4284b9a626ab tempest-GroupsV320Test-1760625041 None] Group tempest-GroupsV320Test-Group-850415279: creating Apr 16 14:37:40 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-565f7dc2-39d4-4919-85ef-4284b9a626ab tempest-GroupsV320Test-1760625041 None] Group tempest-GroupsV320Test-Group-850415279: created successfully Apr 16 14:37:40 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-565f7dc2-39d4-4919-85ef-4284b9a626ab tempest-GroupsV320Test-1760625041 None] Create group completed successfully. Apr 16 14:37:40 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a Apr 16 14:37:40 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:40 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a" returned: 0 in 0.515s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:40 devstack sudo[85461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc 1G Apr 16 14:37:40 devstack sudo[85461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:41 devstack sudo[85461]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:41 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] GroupSnapshot 9c2e9910-de8f-4db3-9999-e8386c31ff3e: creating. Apr 16 14:37:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc 1G" returned: 0 in 0.569s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae80934-5180-40e0-a186-1cc630f3f29a -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:41 devstack sudo[85466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae80934-5180-40e0-a186-1cc630f3f29a -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc Apr 16 14:37:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] Group snapshot 9c2e9910-de8f-4db3-9999-e8386c31ff3e: creating. {{(pid=83305) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 14:37:41 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:41 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-c2d80abe-0809-44a9-a29f-d0283bc03cd6 tempest-GroupsV320Test-1760625041 None] Created reservations ['5805ae70-6b8c-473c-9ac5-723861965ad0'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:42 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c2d80abe-0809-44a9-a29f-d0283bc03cd6 tempest-GroupsV320Test-1760625041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c2d80abe-0809-44a9-a29f-d0283bc03cd6 tempest-GroupsV320Test-1760625041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c2d80abe-0809-44a9-a29f-d0283bc03cd6 tempest-GroupsV320Test-1760625041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c2d80abe-0809-44a9-a29f-d0283bc03cd6 tempest-GroupsV320Test-1760625041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c2d80abe-0809-44a9-a29f-d0283bc03cd6 tempest-GroupsV320Test-1760625041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c2d80abe-0809-44a9-a29f-d0283bc03cd6 tempest-GroupsV320Test-1760625041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae80934-5180-40e0-a186-1cc630f3f29a -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc" returned: 0 in 0.525s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:42 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:42 devstack sudo[85471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:37:42 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:42 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc Apr 16 14:37:42 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:42 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c2d80abe-0809-44a9-a29f-d0283bc03cd6 tempest-GroupsV320Test-1760625041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.458s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-c2d80abe-0809-44a9-a29f-d0283bc03cd6 tempest-GroupsV320Test-1760625041 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:37:42 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c2d80abe-0809-44a9-a29f-d0283bc03cd6 tempest-GroupsV320Test-1760625041 None] Delete group completed successfully. Apr 16 14:37:42 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc" returned: 0 in 0.469s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:42 devstack sudo[85477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.info Apr 16 14:37:42 devstack sudo[85477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:42 devstack sudo[85477]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.info" returned: 0 in 0.488s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:43 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:37:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:43 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.info Apr 16 14:37:43 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:43 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.info" returned: 0 in 0.558s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.220s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.073s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] Creating offline snapshot c48942dc-e4d2-4213-9ec1-f77de8a756d6 of volume e7ea743b-97f1-4b69-8ce9-74908b647367 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:37:43 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05938a4-7024-44a3-8ce3-c7cfd09c0c24]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:43 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-d3a51478-f0e6-4ed8-bb3b-6e537ea67835 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot ca0434e6-2cfb-47da-a1f3-b27123438097: created successfully Apr 16 14:37:43 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 Apr 16 14:37:43 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:44 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367" returned: 0 in 0.674s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:44 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 1G Apr 16 14:37:44 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:44 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 1G" returned: 0 in 0.516s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ea743b-97f1-4b69-8ce9-74908b647367 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:44 devstack sudo[85493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ea743b-97f1-4b69-8ce9-74908b647367 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 Apr 16 14:37:44 devstack sudo[85493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:45 devstack sudo[85493]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ea743b-97f1-4b69-8ce9-74908b647367 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6" returned: 0 in 0.512s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:45 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:37:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:45 devstack sudo[85500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 Apr 16 14:37:45 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:45 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6" returned: 0 in 0.516s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:45 devstack sudo[85503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.info Apr 16 14:37:45 devstack sudo[85503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:46 devstack sudo[85503]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.info" returned: 0 in 0.469s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:46 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:46 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.info Apr 16 14:37:46 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG oslo_service.periodic_task [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:46 devstack sudo[85508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:37:46 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:46 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.info" returned: 0 in 0.620s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.373s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.482s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-b2b4e342-8f78-492d-b5fc-45ded38bd4dc-f176a670-556e-4fef-9a30-1ac042a66e56" by "_create_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-b2b4e342-8f78-492d-b5fc-45ded38bd4dc-f176a670-556e-4fef-9a30-1ac042a66e56" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Creating volume f176a670-556e-4fef-9a30-1ac042a66e56 from snapshot b2b4e342-8f78-492d-b5fc-45ded38bd4dc {{(pid=83305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-f176a670-556e-4fef-9a30-1ac042a66e56" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-f176a670-556e-4fef-9a30-1ac042a66e56" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] snapshot: b2b4e342-8f78-492d-b5fc-45ded38bd4dc, volume: f176a670-556e-4fef-9a30-1ac042a66e56, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0b2e24-3e1b-452f-98e3-537231106e65]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:47 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.591s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:37:47 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-bf04d234-a560-42b0-8914-afcad905a4b5 tempest-GroupSnapshotsV319Test-1983150223 None] group_snapshot 9c2e9910-de8f-4db3-9999-e8386c31ff3e: created successfully Apr 16 14:37:47 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc Apr 16 14:37:47 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:47 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc" returned: 0 in 0.662s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae80934-5180-40e0-a186-1cc630f3f29a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b31fd1-1e07-4933-a310-e80608554c6e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:47 devstack sudo[85517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a Apr 16 14:37:47 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:48 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] group_snapshot 9c2e9910-de8f-4db3-9999-e8386c31ff3e: deleting Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] group_snapshot 9c2e9910-de8f-4db3-9999-e8386c31ff3e: deleting {{(pid=83305) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Acquiring lock "cinder-quobyte-e7ea743b-97f1-4b69-8ce9-74908b647367" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Lock "cinder-quobyte-e7ea743b-97f1-4b69-8ce9-74908b647367" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Acquiring lock "cinder-quobyte-c48942dc-e4d2-4213-9ec1-f77de8a756d6" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Lock "cinder-quobyte-c48942dc-e4d2-4213-9ec1-f77de8a756d6" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Deleting offline snapshot c48942dc-e4d2-4213-9ec1-f77de8a756d6 of volume e7ea743b-97f1-4b69-8ce9-74908b647367 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] snapshot_file for this snap is: volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aa1b50-9aa1-4a36-8507-4e24cece5f73]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:48 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 Apr 16 14:37:48 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:48 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a" returned: 0 in 0.644s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56 not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:48 devstack sudo[85524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56 Apr 16 14:37:48 devstack sudo[85524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:48 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6" returned: 0 in 0.619s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7ea743b-97f1-4b69-8ce9-74908b647367(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[07461e0e-fbb4-4479-a3f2-be4b782e472b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:49 devstack sudo[85550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 Apr 16 14:37:49 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:50 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367" returned: 0 in 1.398s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:50 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 Apr 16 14:37:50 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:51 devstack sudo[85524]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56" returned: 0 in 2.680s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec43691c-08d2-4379-b911-3a1a42241ddb]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:51 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a Apr 16 14:37:51 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:51 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6" returned: 0 in 0.915s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:51 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6 Apr 16 14:37:51 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Flow 'volume_create_manager' (9e9f495a-06c2-4502-af11-8b64f93feeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5888d802-e1a1-4d4b-abb4-a61eae0dddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5888d802-e1a1-4d4b-abb4-a61eae0dddc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-106722309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e433527d-ed2e-409f-8a8f-1b53cfe9b4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4044090eacf4515bb0bb3428084459a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:52Z,use_quota=True,user_id='eff50d87e0dc41738ac892e3634637c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c354e6-b436-4eea-a35c-ebfd6b08017e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c354e6-b436-4eea-a35c-ebfd6b08017e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465ed6bf-ad68-4d83-85a0-56e344414e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465ed6bf-ad68-4d83-85a0-56e344414e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e433527d-ed2e-409f-8a8f-1b53cfe9b4d3', 'volume_name': 'volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f160e0-c192-481e-b895-c036d9bef428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f160e0-c192-481e-b895-c036d9bef428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f991822-a69b-4b7f-8038-5207fca69744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:51 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Volume e433527d-ed2e-409f-8a8f-1b53cfe9b4d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3', 'volume_size': 1} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:51 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367.c48942dc-e4d2-4213-9ec1-f77de8a756d6" returned: 0 in 0.497s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Lock "cinder-quobyte-c48942dc-e4d2-4213-9ec1-f77de8a756d6" released by "_delete_snapshot" :: held 3.535s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Lock "cinder-quobyte-e7ea743b-97f1-4b69-8ce9-74908b647367" released by "delete_snapshot" :: held 3.550s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:51 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a" returned: 0 in 0.769s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a, size 1024.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56 {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:37:51 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Converted 1024.00 MB image at 381.88 MB/s Apr 16 14:37:51 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:51 devstack cinder-volume[83305]: WARNING cinder.quota [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1577916306 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1577916306, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:37:51 devstack cinder-volume[83305]: WARNING cinder.quota [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1577916306 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1577916306, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:37:51 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56 Apr 16 14:37:51 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:51 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] Created reservations ['9ac28cfa-0b78-43b7-8031-a047c2944dc6', '3c9d1d7e-0441-476d-be03-d93026048bba', '62f94946-9fb4-4efa-a04f-465d11104a96', 'b8687bf9-90ca-4319-b346-551d695b6c82'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:51 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-f33ae289-7dec-4d77-aa95-92b923e015d2 tempest-GroupSnapshotsV319Test-1983150223 None] group_snapshot 9c2e9910-de8f-4db3-9999-e8386c31ff3e: deleted successfully Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Acquiring lock "cinder-quobyte-e7ea743b-97f1-4b69-8ce9-74908b647367" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Lock "cinder-quobyte-e7ea743b-97f1-4b69-8ce9-74908b647367" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:52 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56" returned: 0 in 0.435s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-f176a670-556e-4fef-9a30-1ac042a66e56" released by "_copy_volume_from_snapshot" :: held 5.279s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d2888d-fa1f-4fec-9b71-83e867742fd4]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-b2b4e342-8f78-492d-b5fc-45ded38bd4dc-f176a670-556e-4fef-9a30-1ac042a66e56" released by "_create_volume_from_snapshot" :: held 5.320s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.346s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-106722309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e433527d-ed2e-409f-8a8f-1b53cfe9b4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4044090eacf4515bb0bb3428084459a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:37:52Z,use_quota=True,user_id='eff50d87e0dc41738ac892e3634637c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Creating volume e433527d-ed2e-409f-8a8f-1b53cfe9b4d3 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:37:52 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:52 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3 1073741824 Apr 16 14:37:52 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:52 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 Apr 16 14:37:52 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:52 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-0d15251b-0524-4838-9c86-dbb6418869b3 tempest-GroupSnapshotsTest-1671665405 None] Create group from source-snapshot-ca0434e6-2cfb-47da-a1f3-b27123438097 completed successfully. Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-f176a670-556e-4fef-9a30-1ac042a66e56" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-f176a670-556e-4fef-9a30-1ac042a66e56" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[452bba57-cce2-4b18-bd06-8521f97d30ae]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:52 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56 Apr 16 14:37:52 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:52 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367" returned: 0 in 0.573s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:52 devstack sudo[85593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367 Apr 16 14:37:52 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:52 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3 1073741824" returned: 0 in 0.582s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:52 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3 Apr 16 14:37:52 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:53 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e7ea743b-97f1-4b69-8ce9-74908b647367" returned: 0 in 0.443s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Lock "cinder-quobyte-e7ea743b-97f1-4b69-8ce9-74908b647367" released by "delete_volume" :: held 1.061s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:53 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56" returned: 0 in 0.545s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:53 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56 Apr 16 14:37:53 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Created reservations ['75f5cd11-b5e5-476b-b107-e6edbcc02212'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:53 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:53 devstack cinder-volume[83305]: WARNING cinder.quota [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1577916306 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1577916306, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3" returned: 0 in 0.487s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f991822-a69b-4b7f-8038-5207fca69744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3532ad7b-84bd-457d-8556-e64e379d98ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Created reservations ['3746d3a9-c2a3-4cff-b58a-101d4eaaf6d6', '98bf3af5-b90b-4ed2-96b3-e36b96bd77c6', 'fef10d80-80f4-4b50-a65f-67e066f0613d', '4ef17285-98f6-4a76-b576-3f4e2d77de58'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:53 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Volume volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3 (e433527d-ed2e-409f-8a8f-1b53cfe9b4d3): created successfully Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3532ad7b-84bd-457d-8556-e64e379d98ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Flow 'volume_create_manager' (9e9f495a-06c2-4502-af11-8b64f93feeaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:37:53 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-20885c7d-a246-40ef-b3de-9e38db64ae37 tempest-VolumesMetadataTest-84319740 None] Created volume successfully. Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:53 devstack sudo[85604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:37:53 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:53 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f176a670-556e-4fef-9a30-1ac042a66e56" returned: 0 in 0.435s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-f176a670-556e-4fef-9a30-1ac042a66e56" released by "delete_volume" :: held 1.005s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['7809db5d-ad03-4a70-a2ce-59803af97f2b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:53 devstack cinder-volume[83305]: WARNING cinder.quota [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-410039288 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-410039288, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:37:53 devstack cinder-volume[83305]: WARNING cinder.quota [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-410039288 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-410039288, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['30de0d5a-2eb3-48ba-b921-bea6a2b8d021', 'cb783ed0-05a4-4001-9a18-4204dfd0f715', 'c036a0c6-064e-4130-bd70-f375709fe308', 'aab65dee-abe4-4a80-b7a8-fc2c23089e7c'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:53 devstack sudo[85608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:37:53 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:54 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.504s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:54 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:37:54 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-6619ec65-ef4a-421c-b728-c269584084ad tempest-GroupSnapshotsV319Test-1983150223 None] Delete group completed successfully. Apr 16 14:37:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Acquiring lock "cinder-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Lock "cinder-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Acquiring lock "cinder-quobyte-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Lock "cinder-quobyte-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:54 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.478s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:54 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:37:54 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-d34e1dfc-b3c2-4385-ab8b-8287fb93e899 tempest-GroupSnapshotsTest-1671665405 None] Delete group completed successfully. Apr 16 14:37:54 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[527d3629-9240-498e-876a-a27609e0643a]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:54 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3 Apr 16 14:37:54 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:55 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3" returned: 0 in 0.553s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:55 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3 Apr 16 14:37:55 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:55 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot ca0434e6-2cfb-47da-a1f3-b27123438097: deleting Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot ca0434e6-2cfb-47da-a1f3-b27123438097: deleting {{(pid=83305) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-bae80934-5180-40e0-a186-1cc630f3f29a" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-bae80934-5180-40e0-a186-1cc630f3f29a" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-b2b4e342-8f78-492d-b5fc-45ded38bd4dc" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-b2b4e342-8f78-492d-b5fc-45ded38bd4dc" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Deleting offline snapshot b2b4e342-8f78-492d-b5fc-45ded38bd4dc of volume bae80934-5180-40e0-a186-1cc630f3f29a {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] snapshot_file for this snap is: volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31de8bd-9115-4913-8b44-4eeb776b43f7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:55 devstack sudo[85619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc Apr 16 14:37:55 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:55 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3" returned: 0 in 0.703s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Lock "cinder-quobyte-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3" released by "delete_volume" :: held 1.287s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Created reservations ['a14e32cc-f21f-4feb-b229-2611f64e2a76', '901d5690-03ab-44b2-a873-c545f9b2ee9f', 'b2bbf271-1018-4f66-8552-cb5b561f7dc1', 'e55261bb-1e9b-407a-86f4-7e096ac77ab7'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:55 devstack sudo[85624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:37:55 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:55 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc" returned: 0 in 0.813s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae80934-5180-40e0-a186-1cc630f3f29a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d21507c-9fbc-41c4-8217-ce2f1d0e9718]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:56 devstack sudo[85627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a Apr 16 14:37:56 devstack sudo[85627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:56 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.666s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:56 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:37:56 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Deleted volume successfully. Apr 16 14:37:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1ef1bb4e-8ec5-43d6-992e-5835e58de7a8 tempest-VolumesMetadataTest-84319740 None] Lock "cinder-e433527d-ed2e-409f-8a8f-1b53cfe9b4d3-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:56 devstack sudo[85627]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a" returned: 0 in 0.667s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:56 devstack sudo[85633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc Apr 16 14:37:56 devstack sudo[85633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:57 devstack sudo[85633]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc" returned: 0 in 0.465s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:57 devstack sudo[85650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc Apr 16 14:37:57 devstack sudo[85650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:57 devstack sudo[85650]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a.b2b4e342-8f78-492d-b5fc-45ded38bd4dc" returned: 0 in 0.605s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-b2b4e342-8f78-492d-b5fc-45ded38bd4dc" released by "_delete_snapshot" :: held 2.621s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-bae80934-5180-40e0-a186-1cc630f3f29a" released by "delete_snapshot" :: held 2.638s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:57 devstack cinder-volume[83305]: WARNING cinder.quota [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-410039288 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-410039288, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:37:57 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['5b2ce7d4-500a-4987-9ccb-c3e5a82ba0fb', '08575441-dcce-41c1-bd36-fc3274703f99', 'c420927a-63b8-4614-b82c-5cf163f88e84', 'd497deea-625a-4153-9132-ad013ae37aa0'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:57 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-44353942-004a-44ec-98fb-fd4066fa5f24 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot ca0434e6-2cfb-47da-a1f3-b27123438097: deleted successfully Apr 16 14:37:58 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-bae80934-5180-40e0-a186-1cc630f3f29a" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:37:58 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-bae80934-5180-40e0-a186-1cc630f3f29a" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:37:58 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0c65bd-30c9-4130-b5d5-4fd0e26ba2a4]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:37:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:58 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a Apr 16 14:37:58 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:59 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a" returned: 0 in 0.592s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:59 devstack sudo[85663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a Apr 16 14:37:59 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:37:59 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bae80934-5180-40e0-a186-1cc630f3f29a" returned: 0 in 0.545s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-bae80934-5180-40e0-a186-1cc630f3f29a" released by "delete_volume" :: held 1.188s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['b6c7ced8-702d-4fa1-adb6-5662c9556525'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:59 devstack cinder-volume[83305]: WARNING cinder.db.sqlalchemy.api [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-410039288'] Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['1f076dbb-207d-4176-8342-028b399662b6', '950bcdd3-0d29-4f1f-bbc4-570c3d8c432d', 'ecc6dbe4-dee0-44e9-9cc3-96213387461e', '5c0ec6e5-40d9-4486-bce1-998c78537b8b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:37:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:37:59 devstack sudo[85669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:37:59 devstack sudo[85669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:00 devstack sudo[85669]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.505s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:00 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:38:00 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-61d201f2-0bae-4b12-845c-eace8e7826e6 tempest-GroupSnapshotsTest-1671665405 None] Delete group completed successfully. Apr 16 14:38:01 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c0c92be0-1eb7-4c3c-80e8-411dce2b1bd5 tempest-GroupSnapshotsTest-1671665405 None] Group tempest-GroupSnapshotsTest-Group-195962464: creating Apr 16 14:38:01 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c0c92be0-1eb7-4c3c-80e8-411dce2b1bd5 tempest-GroupSnapshotsTest-1671665405 None] Group tempest-GroupSnapshotsTest-Group-195962464: created successfully Apr 16 14:38:01 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c0c92be0-1eb7-4c3c-80e8-411dce2b1bd5 tempest-GroupSnapshotsTest-1671665405 None] Create group completed successfully. Apr 16 14:38:02 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:UPDATE=129,cinder:SELECT=121,cinder:DELETE=7,cinder:INSERT=24 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:38:02 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=138,cinder:UPDATE=140,cinder:INSERT=38,cinder:DELETE=7 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:38:02 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:38:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Flow 'volume_create_manager' (bad76037-75fd-4a62-9846-9450b591af9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be18c4c3-940a-4410-a160-e9e623e2f33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be18c4c3-940a-4410-a160-e9e623e2f33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-768225861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e0e5ce3-5563-4cd5-b329-9aed34bbec37,host='devstack@QuobyteHD#QuobyteHD',id=c3454226-4c9f-442e-b5a1-f3e763162e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d11e2b999664257800bb1433383c2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:03Z,use_quota=True,user_id='106cb889929143709282a85176be278a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b48fc2-0bbd-427b-a819-7840cb09f56f),volume_type_id=c8b48fc2-0bbd-427b-a819-7840cb09f56f)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d26ef34-db14-40a7-b302-987ee1469f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d26ef34-db14-40a7-b302-987ee1469f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386b82c3-0b85-422c-8d11-96413026b670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386b82c3-0b85-422c-8d11-96413026b670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3454226-4c9f-442e-b5a1-f3e763162e72', 'volume_name': 'volume-c3454226-4c9f-442e-b5a1-f3e763162e72', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9860ed-5630-4a33-a040-f9bdca1dd8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9860ed-5630-4a33-a040-f9bdca1dd8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c8396c-551d-42c9-ad46-f40f5997a7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:03 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Volume c3454226-4c9f-442e-b5a1-f3e763162e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3454226-4c9f-442e-b5a1-f3e763162e72', 'volume_size': 1} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e0e5ce3-5563-4cd5-b329-9aed34bbec37,created_at=2026-04-16T12:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-768225861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e0e5ce3-5563-4cd5-b329-9aed34bbec37,host='devstack@QuobyteHD#QuobyteHD',id=c3454226-4c9f-442e-b5a1-f3e763162e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d11e2b999664257800bb1433383c2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:03Z,use_quota=True,user_id='106cb889929143709282a85176be278a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b48fc2-0bbd-427b-a819-7840cb09f56f),volume_type_id=c8b48fc2-0bbd-427b-a819-7840cb09f56f)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Creating volume c3454226-4c9f-442e-b5a1-f3e763162e72 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:38:03 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:38:03 devstack sudo[85703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 1073741824 Apr 16 14:38:03 devstack sudo[85703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Flow 'volume_create_manager' (2950e179-149c-481d-b5ca-f8b125a1047b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5013364f-0361-4939-9f93-9aeadc9e5c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5013364f-0361-4939-9f93-9aeadc9e5c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-300645167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a5d06f-f454-4316-a853-204f1a8c73a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bcbc84d12d4526a61d15108d8df371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:03Z,use_quota=True,user_id='243a8b3785ba4e1daf1c8db5e416e33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e155597-8ba7-4b46-87c7-6de5b47ac8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e155597-8ba7-4b46-87c7-6de5b47ac8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a922dd-8177-407f-8777-c0096cf4d4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a922dd-8177-407f-8777-c0096cf4d4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a5d06f-f454-4316-a853-204f1a8c73a6', 'volume_name': 'volume-81a5d06f-f454-4316-a853-204f1a8c73a6', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be95d21d-7fc4-4fad-a66e-2d0b5915fa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be95d21d-7fc4-4fad-a66e-2d0b5915fa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080243c8-18c3-46da-9648-673b288355f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:03 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Volume 81a5d06f-f454-4316-a853-204f1a8c73a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a5d06f-f454-4316-a853-204f1a8c73a6', 'volume_size': 1} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:03 devstack sudo[85703]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 1073741824" returned: 0 in 0.717s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:03 devstack sudo[85708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 Apr 16 14:38:03 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:04 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72" returned: 0 in 0.611s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.280s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-300645167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a5d06f-f454-4316-a853-204f1a8c73a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bcbc84d12d4526a61d15108d8df371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:03Z,use_quota=True,user_id='243a8b3785ba4e1daf1c8db5e416e33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Creating volume 81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:38:04 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c8396c-551d-42c9-ad46-f40f5997a7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3454226-4c9f-442e-b5a1-f3e763162e72', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb17aa5-5f2f-4d1a-a8a9-24b9c84e8248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:04 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Volume volume-c3454226-4c9f-442e-b5a1-f3e763162e72 (c3454226-4c9f-442e-b5a1-f3e763162e72): created successfully Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb17aa5-5f2f-4d1a-a8a9-24b9c84e8248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:04 devstack sudo[85712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 1073741824 Apr 16 14:38:04 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Flow 'volume_create_manager' (bad76037-75fd-4a62-9846-9450b591af9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:04 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-9da8da9a-30c4-46b2-ba98-d75cce1f8675 tempest-GroupSnapshotsTest-1671665405 None] Created volume successfully. Apr 16 14:38:05 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 1073741824" returned: 0 in 0.688s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:05 devstack sudo[85719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 Apr 16 14:38:05 devstack sudo[85719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Flow 'volume_create_manager' (e3e599e8-3791-4c1b-ad78-b0cb72bab1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc23c31-da81-4fc7-b4a2-b28809a513f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc23c31-da81-4fc7-b4a2-b28809a513f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1517571608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e0e5ce3-5563-4cd5-b329-9aed34bbec37,host='devstack@QuobyteHD#QuobyteHD',id=8151e912-3c64-4a3a-850d-f9673d1047eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d11e2b999664257800bb1433383c2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:06Z,use_quota=True,user_id='106cb889929143709282a85176be278a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b48fc2-0bbd-427b-a819-7840cb09f56f),volume_type_id=c8b48fc2-0bbd-427b-a819-7840cb09f56f)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f3192e-0169-45ce-9b6a-c47320f09cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f3192e-0169-45ce-9b6a-c47320f09cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb588a30-c4bf-40ca-9b39-8a807e00a3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb588a30-c4bf-40ca-9b39-8a807e00a3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8151e912-3c64-4a3a-850d-f9673d1047eb', 'volume_name': 'volume-8151e912-3c64-4a3a-850d-f9673d1047eb', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f4e6ba-2d61-4bde-83a1-3ee936c0b461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f4e6ba-2d61-4bde-83a1-3ee936c0b461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddc65f5-07e1-4625-ac28-94f1c4618be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:05 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Volume 8151e912-3c64-4a3a-850d-f9673d1047eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8151e912-3c64-4a3a-850d-f9673d1047eb', 'volume_size': 1} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:05 devstack sudo[85719]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6" returned: 0 in 0.710s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e0e5ce3-5563-4cd5-b329-9aed34bbec37,created_at=2026-04-16T12:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1517571608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e0e5ce3-5563-4cd5-b329-9aed34bbec37,host='devstack@QuobyteHD#QuobyteHD',id=8151e912-3c64-4a3a-850d-f9673d1047eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d11e2b999664257800bb1433383c2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:06Z,use_quota=True,user_id='106cb889929143709282a85176be278a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8b48fc2-0bbd-427b-a819-7840cb09f56f),volume_type_id=c8b48fc2-0bbd-427b-a819-7840cb09f56f)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Creating volume 8151e912-3c64-4a3a-850d-f9673d1047eb {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:38:05 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080243c8-18c3-46da-9648-673b288355f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a5d06f-f454-4316-a853-204f1a8c73a6', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60381c87-3174-4344-923c-9d708d5295f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:05 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb 1073741824 Apr 16 14:38:05 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:05 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Volume volume-81a5d06f-f454-4316-a853-204f1a8c73a6 (81a5d06f-f454-4316-a853-204f1a8c73a6): created successfully Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60381c87-3174-4344-923c-9d708d5295f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Flow 'volume_create_manager' (2950e179-149c-481d-b5ca-f8b125a1047b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:05 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-17cfe877-636d-4044-9f90-46a4ec3c77c4 tempest-SnapshotsActionsTest-1469791933 None] Created volume successfully. Apr 16 14:38:06 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb 1073741824" returned: 0 in 0.709s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:06 devstack sudo[85728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb Apr 16 14:38:06 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:07 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb" returned: 0 in 0.589s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddc65f5-07e1-4625-ac28-94f1c4618be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8151e912-3c64-4a3a-850d-f9673d1047eb', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2864348c-cfdd-4266-8a5a-1386e5650bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:07 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Volume volume-8151e912-3c64-4a3a-850d-f9673d1047eb (8151e912-3c64-4a3a-850d-f9673d1047eb): created successfully Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2864348c-cfdd-4266-8a5a-1386e5650bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Flow 'volume_create_manager' (e3e599e8-3791-4c1b-ad78-b0cb72bab1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:07 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-2b764e60-eb12-43fe-9521-7d928ce4291d tempest-GroupSnapshotsTest-1671665405 None] Created volume successfully. Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Flow 'volume_create_manager' (40fa79c8-2cbd-438a-b6af-de230664e4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b571d-8c76-40ef-9457-a7793e29eefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b571d-8c76-40ef-9457-a7793e29eefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-418368803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541ed4ca-7cf2-49d3-82dc-7daf44d6630b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f23140eabb424fb3d23aaa9900a886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:07Z,use_quota=True,user_id='05eec40201d6427bb1877cf15988f12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8208f07b-a11e-4e07-ae16-5dbf0d74f1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8208f07b-a11e-4e07-ae16-5dbf0d74f1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f200bf99-8239-41ca-b542-7d3ff6028b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f200bf99-8239-41ca-b542-7d3ff6028b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541ed4ca-7cf2-49d3-82dc-7daf44d6630b', 'volume_name': 'volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2471cd-1b30-4c84-8d1c-fdb44da8ceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2471cd-1b30-4c84-8d1c-fdb44da8ceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00746537-5ee3-4512-a126-782b8f3a00dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:07 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Volume 541ed4ca-7cf2-49d3-82dc-7daf44d6630b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b', 'volume_size': 1} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-418368803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541ed4ca-7cf2-49d3-82dc-7daf44d6630b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f23140eabb424fb3d23aaa9900a886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:07Z,use_quota=True,user_id='05eec40201d6427bb1877cf15988f12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Creating volume 541ed4ca-7cf2-49d3-82dc-7daf44d6630b {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:38:07 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:07 devstack sudo[85731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b 1073741824 Apr 16 14:38:07 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:07 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-f6a9b4d6-b0ea-4873-92dd-78105501f90d tempest-GroupSnapshotsTest-1671665405 None] Update group completed successfully. Apr 16 14:38:07 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b 1073741824" returned: 0 in 0.565s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:08 devstack sudo[85736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b Apr 16 14:38:08 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:08 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" returned: 0 in 0.520s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:38:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.085s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] Creating offline snapshot 8c303f2a-cabf-4de1-8645-0cf549e3884c of volume 81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:38:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00746537-5ee3-4512-a126-782b8f3a00dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603148e1-6ed4-4e6b-b602-384b0b0b74fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:08 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79ce361-d1e4-4dd4-a712-85f378097d5a]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:08 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Volume volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b (541ed4ca-7cf2-49d3-82dc-7daf44d6630b): created successfully Apr 16 14:38:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603148e1-6ed4-4e6b-b602-384b0b0b74fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Flow 'volume_create_manager' (40fa79c8-2cbd-438a-b6af-de230664e4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:08 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-04656e95-007e-42b4-9951-ebb58aeedc8b tempest-VolumesActionsTest-1284819875 None] Created volume successfully. Apr 16 14:38:08 devstack sudo[85764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 Apr 16 14:38:08 devstack sudo[85764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:09 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-08c69e41-9d74-4459-abbd-072f60701501 tempest-GroupSnapshotsTest-1671665405 None] Update group completed successfully. Apr 16 14:38:09 devstack sudo[85764]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6" returned: 0 in 0.576s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:09 devstack sudo[85769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c 1G Apr 16 14:38:09 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:09 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c 1G" returned: 0 in 0.625s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:09 devstack sudo[85774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:09 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:10 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a2c1342f-b153-4bf7-8a79-0ac3832d0c66 tempest-GroupSnapshotsTest-1671665405 None] Update group completed successfully. Apr 16 14:38:10 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.697s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:10 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c is being set with open permissions: ugo+rw Apr 16 14:38:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:10 devstack sudo[85783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:10 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:10 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.486s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:10 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.info Apr 16 14:38:10 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:11 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-22beab34-fd25-4417-9d46-4c193fb90f54 tempest-GroupSnapshotsTest-1671665405 None] Update group completed successfully. Apr 16 14:38:11 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.info" returned: 0 in 0.551s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:11 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.info is being set with open permissions: ugo+rw Apr 16 14:38:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:11 devstack sudo[85791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.info Apr 16 14:38:11 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:11 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.info" returned: 0 in 0.456s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.469s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:12 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-dfbc20e8-a57d-4adf-bb16-3a94a8fc4a3a tempest-SnapshotsActionsTest-1469791933 None] Create snapshot completed successfully Apr 16 14:38:12 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] GroupSnapshot e22528fb-1f90-4fbf-9de3-4dc0302cfacf: creating. Apr 16 14:38:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Group snapshot e22528fb-1f90-4fbf-9de3-4dc0302cfacf: creating. {{(pid=83305) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 14:38:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Creating offline snapshot 281ca1b2-b692-41af-8113-8f4e3666aa0d of volume 8151e912-3c64-4a3a-850d-f9673d1047eb {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:38:12 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[771bf752-8666-4cec-9035-d6c0cb86e463]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:13 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb Apr 16 14:38:13 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:13 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb" returned: 0 in 0.561s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:13 devstack sudo[85807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d 1G Apr 16 14:38:13 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:14 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d 1G" returned: 0 in 0.550s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8151e912-3c64-4a3a-850d-f9673d1047eb -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:14 devstack sudo[85812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8151e912-3c64-4a3a-850d-f9673d1047eb -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d Apr 16 14:38:14 devstack sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:14 devstack sudo[85812]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8151e912-3c64-4a3a-850d-f9673d1047eb -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d" returned: 0 in 0.489s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:14 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:38:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:14 devstack sudo[85817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d Apr 16 14:38:14 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:15 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d" returned: 0 in 0.568s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:15 devstack sudo[85821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.info Apr 16 14:38:15 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:15 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.info" returned: 0 in 0.620s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:15 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:38:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:15 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.info Apr 16 14:38:15 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:16 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.info" returned: 0 in 0.504s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.366s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Creating offline snapshot cb918fba-bdd5-4627-a67c-c8fbaf5e833e of volume c3454226-4c9f-442e-b5a1-f3e763162e72 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:38:16 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[935f7d5c-54a4-4fc5-ad58-11dd1b415f1d]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:16 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 Apr 16 14:38:16 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:16 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72" returned: 0 in 0.544s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:16 devstack sudo[85843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e 1G Apr 16 14:38:16 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:17 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e 1G" returned: 0 in 0.749s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454226-4c9f-442e-b5a1-f3e763162e72 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:17 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454226-4c9f-442e-b5a1-f3e763162e72 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e Apr 16 14:38:17 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:18 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454226-4c9f-442e-b5a1-f3e763162e72 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e" returned: 0 in 0.863s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:18 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:18 devstack sudo[85861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e Apr 16 14:38:18 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Flow 'volume_create_manager' (671b7dfe-7cf9-4183-9db5-61de4ae26c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b9c5ee-9b48-4e41-94ca-b03aa972685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b9c5ee-9b48-4e41-94ca-b03aa972685f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:38:18Z,deleted=False,deleted_at=None,display_description='',display_name='c8d53fe7-3d25-4841-b68f-9451a8c0ef89-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede69f1e-bd94-4169-aaaf-9171eed7b7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def6841df851422abd7ee5a47844a10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:19Z,use_quota=True,user_id='a96d542c1f44490dbc8aec0d3c19122a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b1d033-2f13-414d-84ff-b1ac3f21a4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b1d033-2f13-414d-84ff-b1ac3f21a4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94d096f-3173-49cf-872b-c916473bb4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94d096f-3173-49cf-872b-c916473bb4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede69f1e-bd94-4169-aaaf-9171eed7b7b6', 'volume_name': 'volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad6d0a4-fc4c-4a10-bebc-f253cd69daf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad6d0a4-fc4c-4a10-bebc-f253cd69daf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b606cc-d538-4ff9-89bf-8c850f63e2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:18 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Volume ede69f1e-bd94-4169-aaaf-9171eed7b7b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6', 'volume_size': 1} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:18 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e" returned: 0 in 0.508s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:19 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.info Apr 16 14:38:19 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:19 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.info" returned: 0 in 0.463s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:19 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:38:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:19 devstack sudo[85871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.info Apr 16 14:38:19 devstack sudo[85871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:19 devstack sudo[85871]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.info" returned: 0 in 0.422s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.603s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.923s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] Creating offline snapshot 8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 of volume 81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:38:19 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae964fe-a05f-4c5a-af7c-3cbbb9dde7fc]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:19 devstack sudo[85874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:19 devstack sudo[85874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:19 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-33ed5ce1-529f-4811-b6b6-6c8e94a39f30 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot e22528fb-1f90-4fbf-9de3-4dc0302cfacf: created successfully Apr 16 14:38:20 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot e22528fb-1f90-4fbf-9de3-4dc0302cfacf: deleting Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot e22528fb-1f90-4fbf-9de3-4dc0302cfacf: deleting {{(pid=83305) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-8151e912-3c64-4a3a-850d-f9673d1047eb" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-8151e912-3c64-4a3a-850d-f9673d1047eb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-281ca1b2-b692-41af-8113-8f4e3666aa0d" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:20 devstack sudo[85874]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-281ca1b2-b692-41af-8113-8f4e3666aa0d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Deleting offline snapshot 281ca1b2-b692-41af-8113-8f4e3666aa0d of volume 8151e912-3c64-4a3a-850d-f9673d1047eb {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] snapshot_file for this snap is: volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.585s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a64d209-ce62-4a36-903a-bccf63703b9b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:20 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 1G Apr 16 14:38:20 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:20 devstack sudo[85880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d Apr 16 14:38:20 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:21 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d" returned: 0 in 0.716s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8151e912-3c64-4a3a-850d-f9673d1047eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:21 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d35f623-bee7-42a8-adc9-3edeac9cd1ec]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:21 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 1G" returned: 0 in 0.810s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:21 devstack sudo[85915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb Apr 16 14:38:21 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:21 devstack sudo[85916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 Apr 16 14:38:21 devstack sudo[85916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:22 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb" returned: 0 in 1.034s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:22 devstack sudo[85916]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1" returned: 0 in 1.074s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:22 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 is being set with open permissions: ugo+rw Apr 16 14:38:22 devstack sudo[85963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d Apr 16 14:38:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:22 devstack sudo[85963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:22 devstack sudo[85965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 Apr 16 14:38:22 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:23 devstack sudo[85963]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d" returned: 0 in 0.714s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:23 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1" returned: 0 in 0.632s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:23 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d Apr 16 14:38:23 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.182s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.448s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:38:18Z,deleted=False,deleted_at=None,display_description='',display_name='c8d53fe7-3d25-4841-b68f-9451a8c0ef89-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede69f1e-bd94-4169-aaaf-9171eed7b7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def6841df851422abd7ee5a47844a10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:19Z,use_quota=True,user_id='a96d542c1f44490dbc8aec0d3c19122a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Creating volume ede69f1e-bd94-4169-aaaf-9171eed7b7b6 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:38:23 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:23 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 1073741824 Apr 16 14:38:23 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:23 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-3a143789-140c-44f7-9937-90e11b93c140 tempest-SnapshotsActionsTest-1469791933 None] Create snapshot completed successfully Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-80ea7850-7cc8-4b51-b021-b36364cde158 tempest-VolumesActionsTest-1284819875 None] Acquiring lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" by "attach_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-80ea7850-7cc8-4b51-b021-b36364cde158 tempest-VolumesActionsTest-1284819875 None] Lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" acquired by "attach_volume" :: waited 0.032s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:23 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-80ea7850-7cc8-4b51-b021-b36364cde158 tempest-VolumesActionsTest-1284819875 None] Attaching volume 541ed4ca-7cf2-49d3-82dc-7daf44d6630b to instance b3e25bbd-cb49-4d3f-9c31-fe397be32aa6 at mountpoint /dev/vdb on host None. Apr 16 14:38:23 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-80ea7850-7cc8-4b51-b021-b36364cde158 tempest-VolumesActionsTest-1284819875 None] Attach volume completed successfully. Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-80ea7850-7cc8-4b51-b021-b36364cde158 tempest-VolumesActionsTest-1284819875 None] Lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" released by "attach_volume" :: held 0.163s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:23 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb.281ca1b2-b692-41af-8113-8f4e3666aa0d" returned: 0 in 0.688s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-281ca1b2-b692-41af-8113-8f4e3666aa0d" released by "_delete_snapshot" :: held 3.247s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-8151e912-3c64-4a3a-850d-f9673d1047eb" released by "delete_snapshot" :: held 3.290s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-c3454226-4c9f-442e-b5a1-f3e763162e72" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-c3454226-4c9f-442e-b5a1-f3e763162e72" acquired by "delete_snapshot" :: waited 0.038s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-cb918fba-bdd5-4627-a67c-c8fbaf5e833e" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" acquired by "delete_snapshot" :: waited 0.041s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-quobyte-8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-cb918fba-bdd5-4627-a67c-c8fbaf5e833e" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Deleting offline snapshot cb918fba-bdd5-4627-a67c-c8fbaf5e833e of volume c3454226-4c9f-442e-b5a1-f3e763162e72 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] snapshot_file for this snap is: volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcfd148-0c9e-4569-b2f3-dc195e18fef7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Deleting offline snapshot 8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 of volume 81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] snapshot_file for this snap is: volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd11218-a058-4dde-b69b-70b5f47910e2]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:23 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e Apr 16 14:38:23 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:23 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 1073741824" returned: 0 in 0.868s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:24 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 Apr 16 14:38:24 devstack sudo[85987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 Apr 16 14:38:24 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:24 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-eb31df73-a014-462d-89e2-1aa4dd9f7197 tempest-VolumesActionsTest-1284819875 None] Acquiring lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b-detach_volume" by "detach_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-eb31df73-a014-462d-89e2-1aa4dd9f7197 tempest-VolumesActionsTest-1284819875 None] Lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:24 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-eb31df73-a014-462d-89e2-1aa4dd9f7197 tempest-VolumesActionsTest-1284819875 None] Detaching volume 541ed4ca-7cf2-49d3-82dc-7daf44d6630b from instance b3e25bbd-cb49-4d3f-9c31-fe397be32aa6. Apr 16 14:38:24 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-eb31df73-a014-462d-89e2-1aa4dd9f7197 tempest-VolumesActionsTest-1284819875 None] Detach volume completed successfully. Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-eb31df73-a014-462d-89e2-1aa4dd9f7197 tempest-VolumesActionsTest-1284819875 None] Lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b-detach_volume" released by "detach_volume" :: held 0.169s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:24 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6" returned: 0 in 0.523s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b606cc-d538-4ff9-89bf-8c850f63e2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536f1d5f-f941-4410-acb7-cb5ffd34f115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:24 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Volume volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 (ede69f1e-bd94-4169-aaaf-9171eed7b7b6): created successfully Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536f1d5f-f941-4410-acb7-cb5ffd34f115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Flow 'volume_create_manager' (671b7dfe-7cf9-4183-9db5-61de4ae26c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:24 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-f063e673-225d-4245-8e30-a871b7e5eb96 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Created volume successfully. Apr 16 14:38:24 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e" returned: 0 in 0.778s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3454226-4c9f-442e-b5a1-f3e763162e72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de7f39b-588f-4a6b-89a6-025394b3c406]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:24 devstack sudo[85996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 Apr 16 14:38:24 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:24 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1" returned: 0 in 1.008s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:25 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa6680-e92c-4c09-88a3-f150a9cd7e94]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:25 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:25 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-20382c50-a206-4515-978a-cbee4369bda8 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-20382c50-a206-4515-978a-cbee4369bda8 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:25 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[11230af5-513e-4869-a255-a3f3b0dedbff]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-20382c50-a206-4515-978a-cbee4369bda8 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:25 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 Apr 16 14:38:25 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:25 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.824s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:25 devstack sudo[86029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 Apr 16 14:38:25 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:25 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72" returned: 0 in 1.176s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:25 devstack sudo[86031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e Apr 16 14:38:25 devstack sudo[86031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:26 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-20382c50-a206-4515-978a-cbee4369bda8 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6" returned: 0 in 0.737s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-20382c50-a206-4515-978a-cbee4369bda8 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.811s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-20382c50-a206-4515-978a-cbee4369bda8 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5', 'name': 'volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1a370e7-66f3-4b66-ae1c-345cc1863ff0', 'enforce_multipath': True} {{(pid=83305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 14:38:26 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-c7e124fc-5a01-4123-ab4e-e2e66f35dd8d req-20382c50-a206-4515-978a-cbee4369bda8 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] attachment_update completed successfully. Apr 16 14:38:26 devstack sudo[86031]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e" returned: 0 in 0.657s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:26 devstack sudo[86067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e Apr 16 14:38:26 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:26 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1" returned: 0 in 0.882s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:26 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1 Apr 16 14:38:26 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:27 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72.cb918fba-bdd5-4627-a67c-c8fbaf5e833e" returned: 0 in 0.527s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-cb918fba-bdd5-4627-a67c-c8fbaf5e833e" released by "_delete_snapshot" :: held 3.250s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-c3454226-4c9f-442e-b5a1-f3e763162e72" released by "delete_snapshot" :: held 3.291s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:27 devstack cinder-volume[83305]: WARNING cinder.quota [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1920488489 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1920488489, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:38:27 devstack cinder-volume[83305]: WARNING cinder.quota [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1920488489 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1920488489, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:38:27 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['bfe18cc6-23c1-4eaf-9a76-7891da350c90', 'de4c93bd-61cf-42f9-91ef-cbd7eb488099', 'd3e5e575-9327-4415-b726-58f219222d41', 'f342376c-3d05-4e13-b566-75282eb892b3'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:27 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['d17dbd76-a909-4860-b713-542ad190b03d', 'e646ebb7-a351-48d8-9d5a-d0b2eedbb78b', '9b3f66e6-c9ad-4566-9764-c53e8f9c588f', 'bf4016ac-cd9e-4651-88bb-a8eb0e5f01fe'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:27 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-96eac022-4145-4201-8fb0-b60461f64c04 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot e22528fb-1f90-4fbf-9de3-4dc0302cfacf: deleted successfully Apr 16 14:38:27 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1" returned: 0 in 0.533s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1" released by "_delete_snapshot" :: held 3.388s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" released by "delete_snapshot" :: held 3.436s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:27 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Created reservations ['aa09183a-d66c-41bb-b956-31ad58533ccf', 'bf9efbff-ad61-49a4-b456-2919f3275aca', '081c61a0-1116-47d0-81e3-e3772c7d4165', '6ce8e15f-efed-48d9-917c-9941c9dc41d3'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:27 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Delete snapshot completed successfully. Apr 16 14:38:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ceeea2f4-9a54-4d92-a037-1ad909df3f12 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-8bd5d76b-ccf8-4bbf-bbb1-9ea910b31ab1-delete_snapshot" released by "delete_snapshot" :: held 3.547s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-8151e912-3c64-4a3a-850d-f9673d1047eb" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] Creating offline snapshot da505830-d0ab-431a-86ee-f70ba1ba5e42 of volume 81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-8151e912-3c64-4a3a-850d-f9673d1047eb" acquired by "delete_volume" :: waited 0.051s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[625503a6-e5a6-4866-a7a9-1cc67de38e48]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c86418d-c8b1-4a91-aa60-59c98f7b2c1b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:28 devstack sudo[86142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:28 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:28 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb Apr 16 14:38:28 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:28 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:28 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.545s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb" returned: 0 in 0.543s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:28 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 1G Apr 16 14:38:28 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:28 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb Apr 16 14:38:28 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:29 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8151e912-3c64-4a3a-850d-f9673d1047eb" returned: 0 in 0.481s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-8151e912-3c64-4a3a-850d-f9673d1047eb" released by "delete_volume" :: held 1.066s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-c3454226-4c9f-442e-b5a1-f3e763162e72" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-c3454226-4c9f-442e-b5a1-f3e763162e72" acquired by "delete_volume" :: waited 0.017s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:29 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2631ba-73cb-4de7-8659-cdbeab18792e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:29 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 1G" returned: 0 in 0.607s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:29 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 Apr 16 14:38:29 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:29 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 Apr 16 14:38:29 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:29 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72" returned: 0 in 0.497s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:30 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72 Apr 16 14:38:30 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:30 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42" returned: 0 in 0.475s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:30 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 is being set with open permissions: ugo+rw Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:30 devstack sudo[86176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 Apr 16 14:38:30 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:30 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42" returned: 0 in 0.410s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:30 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c3454226-4c9f-442e-b5a1-f3e763162e72" returned: 0 in 0.507s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:30 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-27d23878-fb3d-4a37-a386-0cd57400537c tempest-SnapshotsActionsTest-1469791933 None] Create snapshot completed successfully Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-c3454226-4c9f-442e-b5a1-f3e763162e72" released by "delete_volume" :: held 1.035s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['f330e664-09f1-49be-b0a0-2c270ad0a9d4'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:30 devstack cinder-volume[83305]: WARNING cinder.quota [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1920488489 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1920488489, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['4ade55f7-4bf0-451d-b97b-975226427766', '74be9ac2-7d9a-42d6-aa60-72b253753f3e', 'e48544eb-fbc8-4adf-ad67-a939283d7392', '94723269-43f4-454a-b405-99ec03ac9ed6'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['518e2465-7cf9-4d40-b997-df66eeea18be', '9cb64840-f032-4a89-a353-72d49c505f33', 'fccd17b4-5eb1-4bd8-a142-c30ac44db908', '5675f0b4-277d-4e40-902e-71a116974de0'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:30 devstack sudo[86496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:38:30 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-da505830-d0ab-431a-86ee-f70ba1ba5e42-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-da505830-d0ab-431a-86ee-f70ba1ba5e42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:31 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-quobyte-da505830-d0ab-431a-86ee-f70ba1ba5e42" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 1.052s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-da505830-d0ab-431a-86ee-f70ba1ba5e42" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Deleting offline snapshot da505830-d0ab-431a-86ee-f70ba1ba5e42 of volume 81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] snapshot_file for this snap is: volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:38:31 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-729a08e1-9e33-4b97-ba38-ccf5da4210c1 tempest-GroupSnapshotsTest-1671665405 None] Delete group completed successfully. Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe8a061-c83b-40aa-848c-96ef7346f0b5]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:32 devstack sudo[86522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 Apr 16 14:38:32 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:32 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5d0fb847-49a8-4f2e-8ea9-8f1b078535ae tempest-GroupSnapshotsTest-1671665405 None] Group tempest-GroupSnapshotsTest-Group-797393666: creating Apr 16 14:38:32 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5d0fb847-49a8-4f2e-8ea9-8f1b078535ae tempest-GroupSnapshotsTest-1671665405 None] Group tempest-GroupSnapshotsTest-Group-797393666: created successfully Apr 16 14:38:32 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5d0fb847-49a8-4f2e-8ea9-8f1b078535ae tempest-GroupSnapshotsTest-1671665405 None] Create group completed successfully. Apr 16 14:38:32 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42" returned: 0 in 0.838s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:32 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:32 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce992b9d-18bd-46bb-8ac5-eed6dfff1878]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:32 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:32 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:33 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.550s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:33 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 Apr 16 14:38:33 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Flow 'volume_create_manager' (380828db-1424-4fd2-bded-db39065df0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9383ef8-9cad-40fc-9dc4-370110b5cee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9383ef8-9cad-40fc-9dc4-370110b5cee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-877554733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f70a5d43-d2bc-4d64-a4f8-68975b66f6c0,host='devstack@QuobyteHD#QuobyteHD',id=aae3ab19-1d2b-41a8-9dbd-9165cea7baa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d11e2b999664257800bb1433383c2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:34Z,use_quota=True,user_id='106cb889929143709282a85176be278a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e7bade-6ac6-4fe9-a5aa-4e3165205661),volume_type_id=59e7bade-6ac6-4fe9-a5aa-4e3165205661)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9337128f-8e10-4975-a246-2f7643a3ac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9337128f-8e10-4975-a246-2f7643a3ac6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106ab616-187d-45ec-9e7d-1eff872a3362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106ab616-187d-45ec-9e7d-1eff872a3362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae3ab19-1d2b-41a8-9dbd-9165cea7baa9', 'volume_name': 'volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ffc464-39a3-4b00-a854-7c1a55324aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ffc464-39a3-4b00-a854-7c1a55324aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec0f89a-a7da-46a3-8659-ed6dfe04d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:33 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Volume aae3ab19-1d2b-41a8-9dbd-9165cea7baa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9', 'volume_size': 1} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f70a5d43-d2bc-4d64-a4f8-68975b66f6c0,created_at=2026-04-16T12:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-877554733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f70a5d43-d2bc-4d64-a4f8-68975b66f6c0,host='devstack@QuobyteHD#QuobyteHD',id=aae3ab19-1d2b-41a8-9dbd-9165cea7baa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d11e2b999664257800bb1433383c2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:34Z,use_quota=True,user_id='106cb889929143709282a85176be278a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e7bade-6ac6-4fe9-a5aa-4e3165205661),volume_type_id=59e7bade-6ac6-4fe9-a5aa-4e3165205661)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Creating volume aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:38:33 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:33 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 1073741824 Apr 16 14:38:33 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:33 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42" returned: 0 in 0.698s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:34 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42 Apr 16 14:38:34 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:34 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 1073741824" returned: 0 in 0.613s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:34 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 Apr 16 14:38:34 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:34 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.da505830-d0ab-431a-86ee-f70ba1ba5e42" returned: 0 in 0.599s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-da505830-d0ab-431a-86ee-f70ba1ba5e42" released by "_delete_snapshot" :: held 2.781s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" released by "delete_snapshot" :: held 2.810s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Created reservations ['5700e63a-99cf-428e-a71a-fe5c1a9797b5', '39a8f45c-e722-4ae6-a429-de3d7099beca', '7b2ae7d5-fbe2-4d89-9101-79fb8a10260f', '4ed01aef-bcfc-4288-bb09-afc900ea25f1'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:34 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Delete snapshot completed successfully. Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f14547f-c32e-4b75-89fe-56c95aa62f76 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-da505830-d0ab-431a-86ee-f70ba1ba5e42-delete_snapshot" released by "delete_snapshot" :: held 2.922s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:34 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9" returned: 0 in 0.484s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec0f89a-a7da-46a3-8659-ed6dfe04d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32868fbb-640f-4ebc-81cb-e3d51e2bd5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:34 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Volume volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 (aae3ab19-1d2b-41a8-9dbd-9165cea7baa9): created successfully Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32868fbb-640f-4ebc-81cb-e3d51e2bd5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Flow 'volume_create_manager' (380828db-1424-4fd2-bded-db39065df0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:34 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cb57c7aa-b8a9-4ce6-a71b-515fc4fa3d94 tempest-GroupSnapshotsTest-1671665405 None] Created volume successfully. Apr 16 14:38:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:35 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] Creating offline snapshot 68bc7796-0029-42ab-adc2-c5f3603e5384 of volume 81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:38:35 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b191819-1641-41c6-91bf-ab4cb5e7082f]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:35 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:35 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:35 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.507s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:35 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:35 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 1G Apr 16 14:38:35 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:36 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] GroupSnapshot f13616ee-5953-410d-9b45-ee3531a7f0d2: creating. Apr 16 14:38:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] Group snapshot f13616ee-5953-410d-9b45-ee3531a7f0d2: creating. {{(pid=83305) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 14:38:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:36 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 1G" returned: 0 in 0.583s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:36 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 Apr 16 14:38:36 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:36 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384" returned: 0 in 0.463s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:36 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 is being set with open permissions: ugo+rw Apr 16 14:38:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:36 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 Apr 16 14:38:36 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:37 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384" returned: 0 in 0.443s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.127s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] Creating offline snapshot b1880595-cbda-445c-aac6-077ed1d7ac67 of volume aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:38:37 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-1a93e394-f401-4adc-a384-97080100e1fc tempest-SnapshotsActionsTest-1469791933 None] Create snapshot completed successfully Apr 16 14:38:37 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c46e116-1090-4ae9-a8fd-519391accdfb]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:37 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 Apr 16 14:38:37 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:37 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9" returned: 0 in 0.517s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:37 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 1G Apr 16 14:38:37 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-68bc7796-0029-42ab-adc2-c5f3603e5384-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-68bc7796-0029-42ab-adc2-c5f3603e5384-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:38 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 1G" returned: 0 in 0.662s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-quobyte-68bc7796-0029-42ab-adc2-c5f3603e5384" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-68bc7796-0029-42ab-adc2-c5f3603e5384" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:38 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 Apr 16 14:38:38 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Deleting offline snapshot 68bc7796-0029-42ab-adc2-c5f3603e5384 of volume 81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] snapshot_file for this snap is: volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dfe34e-f5c1-489d-b364-bb303bcd6557]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:38 devstack sudo[86620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 Apr 16 14:38:38 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:39 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67" returned: 0 in 0.624s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:39 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:38:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:39 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 Apr 16 14:38:39 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:39 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384" returned: 0 in 0.618s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:39 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[545ab7b4-d6e8-4fd9-a54f-3d780dd5f989]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:39 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:39 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:39 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67" returned: 0 in 0.520s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:39 devstack sudo[86635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.info Apr 16 14:38:39 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:39 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.661s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:39 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 Apr 16 14:38:39 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:40 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.info" returned: 0 in 0.594s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:40 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:38:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:40 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.info Apr 16 14:38:40 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:40 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384" returned: 0 in 0.646s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:40 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384 Apr 16 14:38:40 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:40 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.info" returned: 0 in 0.497s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.473s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:40 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-59ee635e-635b-4879-b8e8-0385c3205487 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot f13616ee-5953-410d-9b45-ee3531a7f0d2: created successfully Apr 16 14:38:40 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.68bc7796-0029-42ab-adc2-c5f3603e5384" returned: 0 in 0.553s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-68bc7796-0029-42ab-adc2-c5f3603e5384" released by "_delete_snapshot" :: held 2.530s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" released by "delete_snapshot" :: held 2.554s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Created reservations ['723f49c0-a2a5-4492-a3c7-ae10f387fff8', 'f8f6932e-05aa-4ec6-97c0-f64da64b3fb7', '4ea817d8-841b-46b7-a1fc-4d3fbb535abe', 'a0170461-44b2-4a64-9227-1c2023485bd3'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:41 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Delete snapshot completed successfully. Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-aacbebc2-993d-4735-aba3-9465c2b3e42d tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-68bc7796-0029-42ab-adc2-c5f3603e5384-delete_snapshot" released by "delete_snapshot" :: held 2.665s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:41 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot f13616ee-5953-410d-9b45-ee3531a7f0d2: deleting Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot f13616ee-5953-410d-9b45-ee3531a7f0d2: deleting {{(pid=83305) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-b1880595-cbda-445c-aac6-077ed1d7ac67" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-b1880595-cbda-445c-aac6-077ed1d7ac67" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Deleting offline snapshot b1880595-cbda-445c-aac6-077ed1d7ac67 of volume aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] snapshot_file for this snap is: volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ea16e1-2a2b-40df-b530-38e6fdf5c147]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:41 devstack sudo[86696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 Apr 16 14:38:41 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] Creating offline snapshot 480df565-fa00-4c92-bf68-c0eb0f283c1c of volume 81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95eb392-d29a-4872-bf1a-452706b37ee3]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:41 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:41 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:41 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67" returned: 0 in 0.515s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ea5200-a8f9-400c-810e-060d8a214876]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:42 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 Apr 16 14:38:42 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:42 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.628s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:42 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c 1G Apr 16 14:38:42 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:42 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9" returned: 0 in 0.591s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:42 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 Apr 16 14:38:42 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:42 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c 1G" returned: 0 in 0.521s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:42 devstack sudo[86726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c Apr 16 14:38:42 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:43 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67" returned: 0 in 0.493s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:43 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67 Apr 16 14:38:43 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:43 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c" returned: 0 in 0.461s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:43 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c is being set with open permissions: ugo+rw Apr 16 14:38:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:43 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c Apr 16 14:38:43 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:43 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9.b1880595-cbda-445c-aac6-077ed1d7ac67" returned: 0 in 0.430s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-b1880595-cbda-445c-aac6-077ed1d7ac67" released by "_delete_snapshot" :: held 2.083s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9" released by "delete_snapshot" :: held 2.095s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:43 devstack cinder-volume[83305]: WARNING cinder.quota [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-678272711 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-678272711, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:38:43 devstack cinder-volume[83305]: WARNING cinder.quota [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-678272711 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-678272711, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:38:43 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['7ee615da-579a-4a3e-a1e0-2021392bc1d6', '615c8c18-b613-4b1d-928e-c934df314e5a', 'd638e15a-c009-4a03-8c4a-4f7b72a05207', '57d84132-764b-484e-b668-c9b50ba7f41a'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:43 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b3352798-5c15-4b5b-b091-cf71cd0f71c1 tempest-GroupSnapshotsTest-1671665405 None] group_snapshot f13616ee-5953-410d-9b45-ee3531a7f0d2: deleted successfully Apr 16 14:38:43 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c" returned: 0 in 0.512s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:43 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5aa92fb4-5ef4-4d03-bf0a-90345cdccb54 tempest-SnapshotsActionsTest-1469791933 None] Create snapshot completed successfully Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-480df565-fa00-4c92-bf68-c0eb0f283c1c-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "cinder-quobyte-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-480df565-fa00-4c92-bf68-c0eb0f283c1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Acquiring lock "cinder-quobyte-480df565-fa00-4c92-bf68-c0eb0f283c1c" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9" acquired by "delete_volume" :: waited 0.034s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[338d7c33-8835-4bf7-93f9-8ed01d5204c7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-480df565-fa00-4c92-bf68-c0eb0f283c1c" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Deleting offline snapshot 480df565-fa00-4c92-bf68-c0eb0f283c1c of volume 81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] snapshot_file for this snap is: volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8733e145-9139-4cc5-be53-1a60fa219395]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:45 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 Apr 16 14:38:45 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:45 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c Apr 16 14:38:45 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:45 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9" returned: 0 in 0.669s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:45 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c" returned: 0 in 0.604s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:45 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9 Apr 16 14:38:45 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c7634b-c05e-445c-b5ff-3ccd57e1ac19]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:46 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:46 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG oslo_service.periodic_task [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:46 devstack sudo[86823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:38:46 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-38cf58d8-08f0-4018-a6c5-c9c6fba452af tempest-VolumesActionsTest-1284819875 None] Acquiring lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" by "attach_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-38cf58d8-08f0-4018-a6c5-c9c6fba452af tempest-VolumesActionsTest-1284819875 None] Lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" acquired by "attach_volume" :: waited 0.019s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:46 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-38cf58d8-08f0-4018-a6c5-c9c6fba452af tempest-VolumesActionsTest-1284819875 None] Attaching volume 541ed4ca-7cf2-49d3-82dc-7daf44d6630b to instance 7426f33a-ae37-45fe-9722-254447b61fa7 at mountpoint /dev/vdb on host None. Apr 16 14:38:46 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-38cf58d8-08f0-4018-a6c5-c9c6fba452af tempest-VolumesActionsTest-1284819875 None] Attach volume completed successfully. Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-38cf58d8-08f0-4018-a6c5-c9c6fba452af tempest-VolumesActionsTest-1284819875 None] Lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" released by "attach_volume" :: held 0.133s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:46 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9" returned: 0 in 0.912s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Lock "cinder-quobyte-aae3ab19-1d2b-41a8-9dbd-9165cea7baa9" released by "delete_volume" :: held 1.662s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:46 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['3059f160-dcb6-4a6a-8b5b-2ac3ca35b44f'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:46 devstack cinder-volume[83305]: WARNING cinder.quota [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-678272711 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-678272711, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Created reservations ['722a2377-90e0-4d31-b49a-9d530dd12a38', 'b05c1f89-6a9d-45f4-a05c-6577380f8c10', '0203b059-e88b-496e-ba70-294bffdcf460', '2a48f0ad-1d9a-44a0-8fdc-60ac3dde9b4a'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:47 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 1.104s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:47 devstack sudo[86830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c Apr 16 14:38:47 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:47 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:38:47 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:47 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.869s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-98456138-8439-419e-bbef-e25f07603306 tempest-VolumesActionsTest-1284819875 None] Acquiring lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b-detach_volume" by "detach_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-98456138-8439-419e-bbef-e25f07603306 tempest-VolumesActionsTest-1284819875 None] Lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:47 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-98456138-8439-419e-bbef-e25f07603306 tempest-VolumesActionsTest-1284819875 None] Detaching volume 541ed4ca-7cf2-49d3-82dc-7daf44d6630b from instance 7426f33a-ae37-45fe-9722-254447b61fa7. Apr 16 14:38:47 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-98456138-8439-419e-bbef-e25f07603306 tempest-VolumesActionsTest-1284819875 None] Detach volume completed successfully. Apr 16 14:38:47 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-98456138-8439-419e-bbef-e25f07603306 tempest-VolumesActionsTest-1284819875 None] Lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:48 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.980s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:48 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:38:48 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-116f8120-692b-414b-99a7-ad491e61eea4 tempest-GroupSnapshotsTest-1671665405 None] Delete group completed successfully. Apr 16 14:38:48 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c" returned: 0 in 1.762s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:48 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c Apr 16 14:38:48 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:49 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.480df565-fa00-4c92-bf68-c0eb0f283c1c" returned: 0 in 0.570s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:49 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-480df565-fa00-4c92-bf68-c0eb0f283c1c" released by "_delete_snapshot" :: held 4.186s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:49 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" released by "delete_snapshot" :: held 4.258s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:49 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Created reservations ['b2777705-3186-4960-93a3-3e38e81b4a6f', '43102b78-7ee3-4c10-be45-d00c94c5d195', '51904261-f644-4d5a-af44-58c3d0036dbc', 'bdeaf369-5d99-47eb-b71b-84d4447a731a'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:49 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Delete snapshot completed successfully. Apr 16 14:38:49 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e282db68-aa02-496a-98d8-ab6c03dc1b66 tempest-SnapshotsActionsTest-1228431984 None] Lock "cinder-480df565-fa00-4c92-bf68-c0eb0f283c1c-delete_snapshot" released by "delete_snapshot" :: held 4.386s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "cinder-8c303f2a-cabf-4de1-8645-0cf549e3884c-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Lock "cinder-8c303f2a-cabf-4de1-8645-0cf549e3884c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "cinder-quobyte-8c303f2a-cabf-4de1-8645-0cf549e3884c" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Lock "cinder-quobyte-8c303f2a-cabf-4de1-8645-0cf549e3884c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Deleting offline snapshot 8c303f2a-cabf-4de1-8645-0cf549e3884c of volume 81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:38:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] snapshot_file for this snap is: volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:38:50 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef07433-656d-4e0e-a92c-a38bdc555fd7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:51 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:51 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:51 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.693s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a5d06f-f454-4316-a853-204f1a8c73a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:38:51 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad75c368-0d3a-4218-8b82-b3d8bbc463be]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:51 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 Apr 16 14:38:51 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:52 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6" returned: 0 in 0.646s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:52 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:52 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:52 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.572s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:52 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c Apr 16 14:38:52 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:53 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6.8c303f2a-cabf-4de1-8645-0cf549e3884c" returned: 0 in 0.508s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Lock "cinder-quobyte-8c303f2a-cabf-4de1-8645-0cf549e3884c" released by "_delete_snapshot" :: held 2.506s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" released by "delete_snapshot" :: held 2.524s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:53 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Created reservations ['b101e406-d464-423b-8698-8081f184c09e', 'c119adc5-71d4-464e-a4ab-25fada4a208d', '10f4c3d8-2547-4216-94e5-60617f60d361', '2202e9c7-135b-4e2c-a559-5e34e719ccb1'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:53 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Delete snapshot completed successfully. Apr 16 14:38:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-24b5ead5-5371-4dee-a619-24d1c16edc98 tempest-SnapshotsActionsTest-1469791933 None] Lock "cinder-8c303f2a-cabf-4de1-8645-0cf549e3884c-delete_snapshot" released by "delete_snapshot" :: held 2.606s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "cinder-81a5d06f-f454-4316-a853-204f1a8c73a6-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Lock "cinder-81a5d06f-f454-4316-a853-204f1a8c73a6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:38:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:38:54 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd871c35-f8e0-4c02-920e-8933d93ecb17]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:54 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 Apr 16 14:38:54 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:54 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6" returned: 0 in 0.613s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:54 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6 Apr 16 14:38:54 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:55 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-81a5d06f-f454-4316-a853-204f1a8c73a6" returned: 0 in 0.455s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Lock "cinder-quobyte-81a5d06f-f454-4316-a853-204f1a8c73a6" released by "delete_volume" :: held 1.110s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Created reservations ['66d0c6a9-3a98-477f-a10a-73e1199578d5', '02b5fd06-4f9c-4514-a7e2-acfd6574303d', 'edd234b5-813e-468c-a917-7795cc4fb7d9', 'ed4aacac-c4c2-43f8-a1b3-239282209aba'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:55 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:38:55 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:55 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cb72baa1-4283-4141-9b5d-40569db039c8 tempest-GroupsTest-188325168 None] Group tempest-Group1-1304227276: creating Apr 16 14:38:55 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cb72baa1-4283-4141-9b5d-40569db039c8 tempest-GroupsTest-188325168 None] Group tempest-Group1-1304227276: created successfully Apr 16 14:38:55 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cb72baa1-4283-4141-9b5d-40569db039c8 tempest-GroupsTest-188325168 None] Create group completed successfully. Apr 16 14:38:55 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.458s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:38:55 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Deleted volume successfully. Apr 16 14:38:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-15c5d459-e5f6-4574-9c75-6942164880d4 tempest-SnapshotsActionsTest-1469791933 None] Lock "cinder-81a5d06f-f454-4316-a853-204f1a8c73a6-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:38:56 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-3d06abe3-5fc5-4de5-bffe-5b659547a3c3 tempest-GroupsTest-188325168 None] Group tempest-Group2-321692174: creating Apr 16 14:38:56 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-3d06abe3-5fc5-4de5-bffe-5b659547a3c3 tempest-GroupsTest-188325168 None] Group tempest-Group2-321692174: created successfully Apr 16 14:38:56 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-3d06abe3-5fc5-4de5-bffe-5b659547a3c3 tempest-GroupsTest-188325168 None] Create group completed successfully. Apr 16 14:38:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:38:57 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66369d2-1215-4383-9e85-33d75fd15ef3]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:57 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b Apr 16 14:38:57 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:58 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" returned: 0 in 0.638s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[491fd332-3f92-409d-9eae-bb35df74dd2d]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:58 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b Apr 16 14:38:58 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Flow 'volume_create_manager' (a08b3713-7e44-4d15-89ad-986289d16f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b2757e-7ebd-40f5-859b-1370490752b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b2757e-7ebd-40f5-859b-1370490752b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-107677487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2cc765d-800a-4f75-9a92-9de41ee05cd5,host='devstack@QuobyteHD#QuobyteHD',id=34043ad7-8f96-4a3d-9fc3-c9ddb3349007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e43090eb0fe4f69bbd8d7162c83dcc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:58Z,use_quota=True,user_id='228d0b78b51f4987a513cf6cfb90abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6fd58-e5f2-4830-824d-c992430b86f8),volume_type_id=f6e6fd58-e5f2-4830-824d-c992430b86f8)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bbfc9c-f441-4e7f-b6d0-4da36f92ab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bbfc9c-f441-4e7f-b6d0-4da36f92ab0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03ba060-d93b-47c4-9720-1e429b59b377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03ba060-d93b-47c4-9720-1e429b59b377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34043ad7-8f96-4a3d-9fc3-c9ddb3349007', 'volume_name': 'volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4239fee-05e9-4050-b4b2-a0b5cf14a21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4239fee-05e9-4050-b4b2-a0b5cf14a21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ec6ef9-84b9-40c7-8ca1-0d2e68a5c976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:38:58 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Volume 34043ad7-8f96-4a3d-9fc3-c9ddb3349007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007', 'volume_size': 1} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:38:58 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" returned: 0 in 0.562s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:38:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.2b681df0-dc6f-4065-9562-ac82c103d29d6ffxurnw.img {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:38:58 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.2b681df0-dc6f-4065-9562-ac82c103d29d6ffxurnw.img Apr 16 14:38:58 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:01 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.2b681df0-dc6f-4065-9562-ac82c103d29d6ffxurnw.img" returned: 0 in 2.427s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dcf9c2-319e-467a-a1a2-b12d6d159994]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:01 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b Apr 16 14:39:01 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Flow 'volume_create_manager' (0c0893f5-0292-44dd-a9f4-030eefe5b7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3eb880-ffeb-405d-b7f4-c2747e5ae64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3eb880-ffeb-405d-b7f4-c2747e5ae64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1509665251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1487bf1e-aa28-48a8-bed6-765dc31c74de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a24073e4584437a3cce930ac8f05ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:01Z,use_quota=True,user_id='85f6a7520295472192a0e0290441bd80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2353f705-46ce-406b-b1c9-2daeb1e0dbcc),volume_type_id=2353f705-46ce-406b-b1c9-2daeb1e0dbcc)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9837c7b4-962b-435a-9d07-51d56770d23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9837c7b4-962b-435a-9d07-51d56770d23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341f633f-6d31-402e-9e16-8ed3d4802f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341f633f-6d31-402e-9e16-8ed3d4802f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1487bf1e-aa28-48a8-bed6-765dc31c74de', 'volume_name': 'volume-1487bf1e-aa28-48a8-bed6-765dc31c74de', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8beae0-fbef-4d7a-8444-607a0cdd4948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8beae0-fbef-4d7a-8444-607a0cdd4948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7e84f5-574a-4e3e-8777-a12586aebed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:01 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Volume 1487bf1e-aa28-48a8-bed6-765dc31c74de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1487bf1e-aa28-48a8-bed6-765dc31c74de', 'volume_size': 1} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:01 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" returned: 0 in 0.660s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b, size 1024.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.2b681df0-dc6f-4065-9562-ac82c103d29d6ffxurnw.img {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:39:01 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] Converted 1024.00 MB image at 421.51 MB/s Apr 16 14:39:01 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] 2b681df0-dc6f-4065-9562-ac82c103d29d was raw, no need to convert to raw {{(pid=83305) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 16 14:39:11 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=137,cinder:UPDATE=146,cinder:DELETE=5,cinder:INSERT=29 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:39:11 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=151,cinder:INSERT=35,cinder:UPDATE=109,cinder:DELETE=7 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.236s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] Uploaded volume to glance image-id: 2b681df0-dc6f-4065-9562-ac82c103d29d. {{(pid=83305) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.414s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e2cc765d-800a-4f75-9a92-9de41ee05cd5,created_at=2026-04-16T12:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-107677487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e2cc765d-800a-4f75-9a92-9de41ee05cd5,host='devstack@QuobyteHD#QuobyteHD',id=34043ad7-8f96-4a3d-9fc3-c9ddb3349007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e43090eb0fe4f69bbd8d7162c83dcc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:38:58Z,use_quota=True,user_id='228d0b78b51f4987a513cf6cfb90abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6fd58-e5f2-4830-824d-c992430b86f8),volume_type_id=f6e6fd58-e5f2-4830-824d-c992430b86f8)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Creating volume 34043ad7-8f96-4a3d-9fc3-c9ddb3349007 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:12 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:12 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007 1073741824 Apr 16 14:39:12 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:13 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007 1073741824" returned: 0 in 0.550s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:13 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-4b4aebb6-d26c-4c70-926b-2c29d0ba6211 tempest-VolumesActionsTest-1284819875 None] Copy volume to image completed successfully. Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:13 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007 Apr 16 14:39:13 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:13 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007" returned: 0 in 0.556s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.599s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1509665251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1487bf1e-aa28-48a8-bed6-765dc31c74de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a24073e4584437a3cce930ac8f05ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:01Z,use_quota=True,user_id='85f6a7520295472192a0e0290441bd80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2353f705-46ce-406b-b1c9-2daeb1e0dbcc),volume_type_id=2353f705-46ce-406b-b1c9-2daeb1e0dbcc)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Creating volume 1487bf1e-aa28-48a8-bed6-765dc31c74de {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:13 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:13 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de 1073741824 Apr 16 14:39:13 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ec6ef9-84b9-40c7-8ca1-0d2e68a5c976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d510e49-e79a-4bd3-91f2-73c20fc7b453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:13 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Volume volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007 (34043ad7-8f96-4a3d-9fc3-c9ddb3349007): created successfully Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d510e49-e79a-4bd3-91f2-73c20fc7b453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Flow 'volume_create_manager' (a08b3713-7e44-4d15-89ad-986289d16f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:13 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b3a30eb9-dbe8-493b-b635-6062bd534308 tempest-GroupsTest-188325168 None] Created volume successfully. Apr 16 14:39:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:14 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de 1073741824" returned: 0 in 0.755s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:14 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de Apr 16 14:39:14 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Acquiring lock "cinder-quobyte-34043ad7-8f96-4a3d-9fc3-c9ddb3349007" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Lock "cinder-quobyte-34043ad7-8f96-4a3d-9fc3-c9ddb3349007" acquired by "delete_volume" :: waited 0.017s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[685f31e2-0ecb-485b-980a-fb455bfc50e7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:15 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007 Apr 16 14:39:15 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:15 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de" returned: 0 in 0.543s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.718s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7e84f5-574a-4e3e-8777-a12586aebed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1487bf1e-aa28-48a8-bed6-765dc31c74de', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2455927e-49c1-4e32-ab60-ed6de6ce9936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ef58e5-ba68-4c4a-96fe-d4b2f2e5da88]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:15 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Volume volume-1487bf1e-aa28-48a8-bed6-765dc31c74de (1487bf1e-aa28-48a8-bed6-765dc31c74de): created successfully Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2455927e-49c1-4e32-ab60-ed6de6ce9936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Flow 'volume_create_manager' (0c0893f5-0292-44dd-a9f4-030eefe5b7a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:15 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-9da63050-5163-4d93-8c51-a4692f936dc3 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Created volume successfully. Apr 16 14:39:15 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b Apr 16 14:39:15 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:15 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007" returned: 0 in 0.556s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:15 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007 Apr 16 14:39:15 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:15 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" returned: 0 in 0.493s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8584e6-f10d-4103-b44f-bb3bd42c253d]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:15 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b Apr 16 14:39:15 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:16 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-34043ad7-8f96-4a3d-9fc3-c9ddb3349007" returned: 0 in 0.481s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Lock "cinder-quobyte-34043ad7-8f96-4a3d-9fc3-c9ddb3349007" released by "delete_volume" :: held 1.074s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Created reservations ['a115c619-94c9-409a-bfab-0915edceef10'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:16 devstack cinder-volume[83305]: WARNING cinder.quota [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-649704547 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-649704547, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:39:16 devstack cinder-volume[83305]: WARNING cinder.quota [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-649704547 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-649704547, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Created reservations ['700f885d-d30b-4061-9935-eaf380e7fd5c', 'f7ebd988-c3d4-4fa0-a1f5-697f0cb0856e', 'fa17056a-5af0-4aa2-9137-f7e37859719d', '2205d8d7-9877-49df-b4e3-6de651d62610'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:16 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" returned: 0 in 0.621s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:16 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:16 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:16 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img Apr 16 14:39:16 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2879e7ef-eaf0-47af-a528-75c0f8934567 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2879e7ef-eaf0-47af-a528-75c0f8934567 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2879e7ef-eaf0-47af-a528-75c0f8934567 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2879e7ef-eaf0-47af-a528-75c0f8934567 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2879e7ef-eaf0-47af-a528-75c0f8934567 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2879e7ef-eaf0-47af-a528-75c0f8934567 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:16 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:16 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:16 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.467s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:16 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c6eadd5f-c3c5-446d-ade6-f3fe49da0c8e tempest-GroupsTest-188325168 None] Delete group completed successfully. Apr 16 14:39:16 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2879e7ef-eaf0-47af-a528-75c0f8934567 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.574s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:16 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-2879e7ef-eaf0-47af-a528-75c0f8934567 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:16 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-2879e7ef-eaf0-47af-a528-75c0f8934567 tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Retype volume completed successfully. Apr 16 14:39:17 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-77dfdbda-550c-4825-bb57-7ad590283f4a tempest-GroupsTest-188325168 None] Created reservations ['c63dd440-6852-4a9c-97a5-bc199f5d4945'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-77dfdbda-550c-4825-bb57-7ad590283f4a tempest-GroupsTest-188325168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-77dfdbda-550c-4825-bb57-7ad590283f4a tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:17 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-77dfdbda-550c-4825-bb57-7ad590283f4a tempest-GroupsTest-188325168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:17 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-77dfdbda-550c-4825-bb57-7ad590283f4a tempest-GroupsTest-188325168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-77dfdbda-550c-4825-bb57-7ad590283f4a tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-77dfdbda-550c-4825-bb57-7ad590283f4a tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:17 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:17 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Acquiring lock "cinder-1487bf1e-aa28-48a8-bed6-765dc31c74de-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "cinder-1487bf1e-aa28-48a8-bed6-765dc31c74de-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Acquiring lock "cinder-quobyte-1487bf1e-aa28-48a8-bed6-765dc31c74de" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "cinder-quobyte-1487bf1e-aa28-48a8-bed6-765dc31c74de" acquired by "delete_volume" :: waited 0.029s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:18 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c63b05f-14a1-440b-b2e9-4abce346a0d5]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:18 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de Apr 16 14:39:18 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:18 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-77dfdbda-550c-4825-bb57-7ad590283f4a tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 1.110s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:18 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-77dfdbda-550c-4825-bb57-7ad590283f4a tempest-GroupsTest-188325168 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:18 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-77dfdbda-550c-4825-bb57-7ad590283f4a tempest-GroupsTest-188325168 None] Delete group completed successfully. Apr 16 14:39:19 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img" returned: 0 in 2.935s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:19 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f21964-1087-4bff-93e8-7ba2e95a8d51]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:19 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b Apr 16 14:39:19 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:19 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de" returned: 0 in 1.264s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:19 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de Apr 16 14:39:19 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:19 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cf7f6424-b2b5-4547-8285-49a40fb1a3c2 tempest-GroupsTest-188325168 None] Group tempest-GroupsTest-Group-664306316: creating Apr 16 14:39:19 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cf7f6424-b2b5-4547-8285-49a40fb1a3c2 tempest-GroupsTest-188325168 None] Group tempest-GroupsTest-Group-664306316: created successfully Apr 16 14:39:19 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cf7f6424-b2b5-4547-8285-49a40fb1a3c2 tempest-GroupsTest-188325168 None] Create group completed successfully. Apr 16 14:39:20 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1487bf1e-aa28-48a8-bed6-765dc31c74de" returned: 0 in 0.579s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "cinder-quobyte-1487bf1e-aa28-48a8-bed6-765dc31c74de" released by "delete_volume" :: held 1.882s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:20 devstack cinder-volume[83305]: WARNING cinder.quota [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:39:20 devstack cinder-volume[83305]: WARNING cinder.quota [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Created reservations ['48ec5ffa-4e82-4c55-b1b9-db1856c38a32', '94a2dbf8-09a7-44ec-967d-ecadc9eb0bb9', '643145cb-b21c-4cc7-9a47-848a5f3122c2', '60309775-a084-40d5-93a3-b00c9b2f8c39'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:20 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:20 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:20 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" returned: 0 in 1.005s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b, size 1024.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:39:20 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Converted 1024.00 MB image at 348.83 MB/s Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] ece29250-9a43-4b78-bd12-8b7152cdc503 was raw, converting to qcow2 {{(pid=83305) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13627dd-e9fe-4388-a788-2f891734fe27]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:20 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img Apr 16 14:39:20 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:21 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.836s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:21 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Deleted volume successfully. Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-599efdd0-dc8d-48a2-aa79-99096d35e50a tempest-VolumeRetypeWithoutMigrationTest-568151945 None] Lock "cinder-1487bf1e-aa28-48a8-bed6-765dc31c74de-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Flow 'volume_create_manager' (b98f113a-5891-449e-bd3a-874b9a54811e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea843ca-ca67-4d7c-a530-d81779350948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea843ca-ca67-4d7c-a530-d81779350948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-801439607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e5b57da-6f04-4343-bb99-d2c3d7df809c,host='devstack@QuobyteHD#QuobyteHD',id=a654524a-9fe9-44e3-a819-3bde3885fb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e43090eb0fe4f69bbd8d7162c83dcc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:21Z,use_quota=True,user_id='228d0b78b51f4987a513cf6cfb90abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a317bfd-b033-4758-905a-b478296246a6),volume_type_id=2a317bfd-b033-4758-905a-b478296246a6)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8112a62d-38bc-4717-9d79-e2806bae1d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8112a62d-38bc-4717-9d79-e2806bae1d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd93f0b4-e52b-4ffa-8e65-e83e1ef48ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd93f0b4-e52b-4ffa-8e65-e83e1ef48ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a654524a-9fe9-44e3-a819-3bde3885fb9f', 'volume_name': 'volume-a654524a-9fe9-44e3-a819-3bde3885fb9f', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d348dd6-3414-4db6-ad6c-018b51ac4cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d348dd6-3414-4db6-ad6c-018b51ac4cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dca6b5-10aa-4c53-ba3e-aee5176d53b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:21 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Volume a654524a-9fe9-44e3-a819-3bde3885fb9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a654524a-9fe9-44e3-a819-3bde3885fb9f', 'volume_size': 1} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Flow 'volume_create_manager' (b3beb33e-f032-49fc-9dcb-ec1e903cb932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186d236d-4379-4255-b00c-0789f8d1d89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186d236d-4379-4255-b00c-0789f8d1d89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:21Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def6841df851422abd7ee5a47844a10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:21Z,use_quota=True,user_id='a96d542c1f44490dbc8aec0d3c19122a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78010860-e91c-45d9-80c8-7d2d2e103ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78010860-e91c-45d9-80c8-7d2d2e103ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99ccf4c-eae3-4a11-89bd-061300e3d5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.image.glance [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Creating Keystone auth plugin from conf {{(pid=83305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 14:39:21 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img" returned: 0 in 1.161s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:21 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img Apr 16 14:39:21 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99ccf4c-eae3-4a11-89bd-061300e3d5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab', 'volume_name': 'volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9eb55b-7e5d-4e50-8ed3-e34646142d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9eb55b-7e5d-4e50-8ed3-e34646142d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3f108f-63aa-42cf-8840-073f2fe64869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:21 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Volume 6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 14:39:21 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Trying to clone 6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab from image a03b4007-0186-44e1-a560-91d8e58559a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]). {{(pid=83305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 14:39:22 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 14:39:22 devstack cinder-volume[83305]: INFO cinder.image.image_utils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Image download 20.69 MB at 20.69 MB/s Apr 16 14:39:22 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de1a473-efb2-49bc-b69c-ff69d3f0dffa]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:22 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD Apr 16 14:39:22 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:22 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img" returned: 1 in 0.951s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:39:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img /opt/stack/data/cinder/conversion/vol_upload_eybh183h {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:22 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img /opt/stack/data/cinder/conversion/vol_upload_eybh183h Apr 16 14:39:22 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:22 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD" returned: 0 in 0.588s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:22 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Temporary image a03b4007-0186-44e1-a560-91d8e58559a1 is fetched for user a96d542c1f44490dbc8aec0d3c19122a. {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 14:39:22 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a66f36-cf82-4548-87fe-8ff65a2d8c49]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:22 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD Apr 16 14:39:22 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:23 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img /opt/stack/data/cinder/conversion/vol_upload_eybh183h" returned: 0 in 0.769s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:23 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Image conversion details: src /opt/stack/data/cinder/conversion/541ed4ca-7cf2-49d3-82dc-7daf44d6630b.temp_image.ece29250-9a43-4b78-bd12-8b7152cdc503xv_577n3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_eybh183h {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:39:23 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 16 14:39:23 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc514149-1935-47e4-8a5e-aae1e2705c7e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eybh183h {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:23 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eybh183h Apr 16 14:39:23 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:23 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD" returned: 0 in 0.771s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:23 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eybh183h" returned: 0 in 0.728s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.755s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Uploaded volume to glance image-id: ece29250-9a43-4b78-bd12-8b7152cdc503. {{(pid=83305) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 14:39:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.606s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e5b57da-6f04-4343-bb99-d2c3d7df809c,created_at=2026-04-16T12:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-801439607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e5b57da-6f04-4343-bb99-d2c3d7df809c,host='devstack@QuobyteHD#QuobyteHD',id=a654524a-9fe9-44e3-a819-3bde3885fb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e43090eb0fe4f69bbd8d7162c83dcc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:21Z,use_quota=True,user_id='228d0b78b51f4987a513cf6cfb90abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a317bfd-b033-4758-905a-b478296246a6),volume_type_id=2a317bfd-b033-4758-905a-b478296246a6)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Creating volume a654524a-9fe9-44e3-a819-3bde3885fb9f {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:25 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:25 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f 1073741824 Apr 16 14:39:25 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:25 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-9fbbbf18-4356-477b-81eb-aa7bdf8c9d62 tempest-VolumesActionsTest-1284819875 None] Copy volume to image completed successfully. Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Flow 'volume_create_manager' (c54c5f33-1b07-4c17-ab67-22b3b18bd650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05acf9ef-842b-4644-993f-b3c928cf176f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05acf9ef-842b-4644-993f-b3c928cf176f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-437514912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4958b9e1-05d4-40ac-b713-a5b0d35759f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d3c612b17f4efab01e10a4f963ae2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:25Z,use_quota=True,user_id='35fd5778a2c549e49a14d967163cc43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fcc93c-acc5-4cb2-8269-c2dd508c1694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fcc93c-acc5-4cb2-8269-c2dd508c1694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0189000f-8d4d-4d4c-be54-3a96cca832ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0189000f-8d4d-4d4c-be54-3a96cca832ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4958b9e1-05d4-40ac-b713-a5b0d35759f5', 'volume_name': 'volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2df2f33-016a-403d-9043-73c3a1526dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2df2f33-016a-403d-9043-73c3a1526dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f822f24-d141-4a40-9f50-5eb31d4643dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:25 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Volume 4958b9e1-05d4-40ac-b713-a5b0d35759f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5', 'volume_size': 1} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:25 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f 1073741824" returned: 0 in 0.541s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:25 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f Apr 16 14:39:25 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:26 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f" returned: 0 in 0.501s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.434s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:21Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def6841df851422abd7ee5a47844a10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:21Z,use_quota=True,user_id='a96d542c1f44490dbc8aec0d3c19122a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Creating volume 6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:26 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dca6b5-10aa-4c53-ba3e-aee5176d53b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a654524a-9fe9-44e3-a819-3bde3885fb9f', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e4a58d-1909-46b4-9b85-77775d117c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:26 devstack sudo[87287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab 1073741824 Apr 16 14:39:26 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:26 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Volume volume-a654524a-9fe9-44e3-a819-3bde3885fb9f (a654524a-9fe9-44e3-a819-3bde3885fb9f): created successfully Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e4a58d-1909-46b4-9b85-77775d117c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Flow 'volume_create_manager' (b98f113a-5891-449e-bd3a-874b9a54811e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:26 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-8b521c33-3cce-41ae-ba45-7641e888f379 tempest-GroupsTest-188325168 None] Created volume successfully. Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Acquiring lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Acquiring lock "cinder-quobyte-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Lock "cinder-quobyte-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" acquired by "delete_volume" :: waited 0.023s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05aba47-99d2-43fc-b04b-4a3739085dad]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:26 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b Apr 16 14:39:26 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:26 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab 1073741824" returned: 0 in 0.572s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:26 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab Apr 16 14:39:26 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:27 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" returned: 0 in 0.585s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:27 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b Apr 16 14:39:27 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Flow 'volume_create_manager' (a67c3497-a3dc-47a9-b348-0a8056404d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798ff424-928e-4a68-ad78-23da58031f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798ff424-928e-4a68-ad78-23da58031f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-62518719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e5b57da-6f04-4343-bb99-d2c3d7df809c,host='devstack@QuobyteHD#QuobyteHD',id=4b0f8b50-bec4-409c-b178-af1e1d1bc494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e43090eb0fe4f69bbd8d7162c83dcc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:27Z,use_quota=True,user_id='228d0b78b51f4987a513cf6cfb90abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a317bfd-b033-4758-905a-b478296246a6),volume_type_id=2a317bfd-b033-4758-905a-b478296246a6)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dfee85-64be-4406-9cca-fdd91875926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dfee85-64be-4406-9cca-fdd91875926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedc65dc-2753-41ad-97cc-b959a49d26e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedc65dc-2753-41ad-97cc-b959a49d26e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0f8b50-bec4-409c-b178-af1e1d1bc494', 'volume_name': 'volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6aff22-e896-4896-91f9-ef5f4ec0f469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6aff22-e896-4896-91f9-ef5f4ec0f469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5529b39-6eab-4679-a3fc-e5d20328a8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:27 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Volume 4b0f8b50-bec4-409c-b178-af1e1d1bc494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494', 'volume_size': 1} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:27 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" returned: 0 in 0.590s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.169s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-437514912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4958b9e1-05d4-40ac-b713-a5b0d35759f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d3c612b17f4efab01e10a4f963ae2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:25Z,use_quota=True,user_id='35fd5778a2c549e49a14d967163cc43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Creating volume 4958b9e1-05d4-40ac-b713-a5b0d35759f5 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:27 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Attempting download of a03b4007-0186-44e1-a560-91d8e58559a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}])) to volume 6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab. {{(pid=83305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 14:39:27 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5 1073741824 Apr 16 14:39:27 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaeb4ce-a84c-4ba4-a881-a3eaf79272e0]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_hlt30773 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:27 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_hlt30773 Apr 16 14:39:27 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:27 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" returned: 0 in 0.562s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Lock "cinder-quobyte-541ed4ca-7cf2-49d3-82dc-7daf44d6630b" released by "delete_volume" :: held 1.167s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Created reservations ['02e42d0e-2fa0-4a0a-82a1-4e4db41a63a1', 'ad7964bd-11c8-43c9-970c-960ce3fea909', '9ae38e66-025a-40df-a31b-a13fbf4facc7', '13609434-ec5f-441d-8da0-e36361522893'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:27 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:27 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:27 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5 1073741824" returned: 0 in 0.605s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:27 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_hlt30773" returned: 0 in 0.564s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_hlt30773 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:27 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5 Apr 16 14:39:27 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:28 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_hlt30773 Apr 16 14:39:28 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:28 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.504s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:28 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Deleted volume successfully. Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-06a435b3-eb37-41b7-bfe5-9b9d3c0909c8 tempest-VolumesActionsTest-1284819875 None] Lock "cinder-541ed4ca-7cf2-49d3-82dc-7daf44d6630b-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:28 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5" returned: 0 in 0.525s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.255s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e5b57da-6f04-4343-bb99-d2c3d7df809c,created_at=2026-04-16T12:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-62518719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e5b57da-6f04-4343-bb99-d2c3d7df809c,host='devstack@QuobyteHD#QuobyteHD',id=4b0f8b50-bec4-409c-b178-af1e1d1bc494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e43090eb0fe4f69bbd8d7162c83dcc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:27Z,use_quota=True,user_id='228d0b78b51f4987a513cf6cfb90abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a317bfd-b033-4758-905a-b478296246a6),volume_type_id=2a317bfd-b033-4758-905a-b478296246a6)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Creating volume 4b0f8b50-bec4-409c-b178-af1e1d1bc494 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:28 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f822f24-d141-4a40-9f50-5eb31d4643dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed50b36-67a6-4dbc-8433-61929bca4c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:28 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494 1073741824 Apr 16 14:39:28 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:28 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Volume volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5 (4958b9e1-05d4-40ac-b713-a5b0d35759f5): created successfully Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed50b36-67a6-4dbc-8433-61929bca4c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Flow 'volume_create_manager' (c54c5f33-1b07-4c17-ab67-22b3b18bd650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:28 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_hlt30773" returned: 1 in 0.565s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_hlt30773' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1f1a50-d7f2-4122-b7f0-b46f84a6d59a]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:28 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-60aa6729-948f-46cc-9359-e8bca6db9231 tempest-VolumesServicesTestJSON-1598692387 None] Created volume successfully. Apr 16 14:39:28 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD Apr 16 14:39:28 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:29 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494 1073741824" returned: 0 in 0.531s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:29 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494 Apr 16 14:39:29 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:29 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD" returned: 0 in 0.578s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] a03b4007-0186-44e1-a560-91d8e58559a1 was qcow2, converting to raw {{(pid=83305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:29 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab Apr 16 14:39:29 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Acquiring lock "cinder-4958b9e1-05d4-40ac-b713-a5b0d35759f5-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Lock "cinder-4958b9e1-05d4-40ac-b713-a5b0d35759f5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Acquiring lock "cinder-quobyte-4958b9e1-05d4-40ac-b713-a5b0d35759f5" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Lock "cinder-quobyte-4958b9e1-05d4-40ac-b713-a5b0d35759f5" acquired by "delete_volume" :: waited 0.015s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[669f550d-d87a-4db0-8112-7a33ca1e8ca0]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:29 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5 Apr 16 14:39:29 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:29 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494" returned: 0 in 0.772s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5529b39-6eab-4679-a3fc-e5d20328a8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5c2795-54a4-4f33-aea7-2df667e913ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:29 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Volume volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494 (4b0f8b50-bec4-409c-b178-af1e1d1bc494): created successfully Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5c2795-54a4-4f33-aea7-2df667e913ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Flow 'volume_create_manager' (a67c3497-a3dc-47a9-b348-0a8056404d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:29 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-48934428-788a-449b-946a-b042d6dd6ae9 tempest-GroupsTest-188325168 None] Created volume successfully. Apr 16 14:39:30 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" returned: 0 in 1.279s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:30 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_v0zsw3h4devstack@QuobyteHD, size 112.00 MB, duration 1.28 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:39:30 devstack cinder-volume[83305]: INFO cinder.image.image_utils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Converted 112.00 MB image at 87.48 MB/s Apr 16 14:39:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:30 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab 1G Apr 16 14:39:30 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:30 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5" returned: 0 in 0.898s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:30 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5 Apr 16 14:39:30 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:30 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-05eac23e-f768-4d78-af25-8e745f2de6d8 tempest-GroupsTest-188325168 None] Update group completed successfully. Apr 16 14:39:31 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4958b9e1-05d4-40ac-b713-a5b0d35759f5" returned: 0 in 0.760s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:31 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab 1G" returned: 0 in 0.845s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Lock "cinder-quobyte-4958b9e1-05d4-40ac-b713-a5b0d35759f5" released by "delete_volume" :: held 1.690s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[697c597d-dcaa-42a3-8db2-ffab4855297a]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Created reservations ['917896ef-e1d3-4cd6-9d04-c90d6761d30c', '255a15b7-9260-4412-8ff2-e14d215984b6', '7d3a915e-2547-41a0-8177-28f979b309cf', '801ca89b-dc5a-48f9-b5f5-8e19cb0f4bb8'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:31 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab Apr 16 14:39:31 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:31 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:31 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:32 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c9310a2e-fbe6-46f0-80e7-82c968ff4e2d tempest-GroupsTest-188325168 None] Update group completed successfully. Apr 16 14:39:32 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.748s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:32 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:32 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Deleted volume successfully. Apr 16 14:39:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-91e8e7ac-22d7-4896-a1ed-0aaca45c35a5 tempest-VolumesServicesTestJSON-1598692387 None] Lock "cinder-4958b9e1-05d4-40ac-b713-a5b0d35759f5-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:32 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" returned: 0 in 1.163s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:32 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab Apr 16 14:39:32 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:33 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" returned: 1 in 0.720s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Downloaded image a03b4007-0186-44e1-a560-91d8e58559a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}])) to volume 6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab successfully. {{(pid=83305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Temporary image a03b4007-0186-44e1-a560-91d8e58559a1 for user a96d542c1f44490dbc8aec0d3c19122a is deleted. {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Marking volume 6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab as bootable. {{(pid=83305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Copying metadata from image a03b4007-0186-44e1-a560-91d8e58559a1 to 6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab. {{(pid=83305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Creating volume glance metadata for volume 6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab backed by image a03b4007-0186-44e1-a560-91d8e58559a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3f108f-63aa-42cf-8840-073f2fe64869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe231747-c549-4488-9ba4-22fda4e5aefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:33 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Volume volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab (6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab): created successfully Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe231747-c549-4488-9ba4-22fda4e5aefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Flow 'volume_create_manager' (b3beb33e-f032-49fc-9dcb-ec1e903cb932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:33 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-be63ca23-6c50-447b-b370-677eeeff93a7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Created volume successfully. Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Acquiring lock "cinder-quobyte-4b0f8b50-bec4-409c-b178-af1e1d1bc494" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Lock "cinder-quobyte-4b0f8b50-bec4-409c-b178-af1e1d1bc494" acquired by "delete_volume" :: waited 0.019s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[638f4c97-c8b4-4112-a9a1-4b0d5e93e322]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:33 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494 Apr 16 14:39:33 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-2cd7a9e8-716f-4347-9fdc-29174c95b1e4 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-2cd7a9e8-716f-4347-9fdc-29174c95b1e4 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb63a28-2837-4273-8410-550f12ed38e4]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-2cd7a9e8-716f-4347-9fdc-29174c95b1e4 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:34 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab Apr 16 14:39:34 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:34 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494" returned: 0 in 0.911s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:34 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494 Apr 16 14:39:34 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Flow 'volume_create_manager' (808708a2-6e1a-4f9d-8f9b-c84863160f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e98f598-eaaa-4283-b777-a4fe6c336ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e98f598-eaaa-4283-b777-a4fe6c336ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-441915059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55917814-0a34-4615-942a-b7ae4044161c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96fe9e76dc6486a93428d99e6b13d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:35Z,use_quota=True,user_id='5721a0dff51a44e7bb87cf67765ab398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a3202a-18f1-487f-aea3-2f4735929e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a3202a-18f1-487f-aea3-2f4735929e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6042bc79-d725-488f-84b1-b4e47a471782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6042bc79-d725-488f-84b1-b4e47a471782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55917814-0a34-4615-942a-b7ae4044161c', 'volume_name': 'volume-55917814-0a34-4615-942a-b7ae4044161c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f16be17-c5a1-4cf1-9bf3-a98d8c7a325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f16be17-c5a1-4cf1-9bf3-a98d8c7a325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8063a250-2304-4573-b729-b499fa2bcf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:34 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Volume 55917814-0a34-4615-942a-b7ae4044161c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55917814-0a34-4615-942a-b7ae4044161c', 'volume_size': 1} Apr 16 14:39:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:35 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-2cd7a9e8-716f-4347-9fdc-29174c95b1e4 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" returned: 0 in 0.698s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-2cd7a9e8-716f-4347-9fdc-29174c95b1e4 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:35 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab Apr 16 14:39:35 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:35 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4b0f8b50-bec4-409c-b178-af1e1d1bc494" returned: 0 in 0.654s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Lock "cinder-quobyte-4b0f8b50-bec4-409c-b178-af1e1d1bc494" released by "delete_volume" :: held 1.597s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Acquiring lock "cinder-quobyte-a654524a-9fe9-44e3-a819-3bde3885fb9f" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Lock "cinder-quobyte-a654524a-9fe9-44e3-a819-3bde3885fb9f" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c68060f-1a97-4ff9-84a8-ac1d93287eac]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:35 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f Apr 16 14:39:35 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:35 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-2cd7a9e8-716f-4347-9fdc-29174c95b1e4 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" returned: 1 in 0.695s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-2cd7a9e8-716f-4347-9fdc-29174c95b1e4 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-2cd7a9e8-716f-4347-9fdc-29174c95b1e4 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.438s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.906s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-441915059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55917814-0a34-4615-942a-b7ae4044161c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96fe9e76dc6486a93428d99e6b13d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:35Z,use_quota=True,user_id='5721a0dff51a44e7bb87cf67765ab398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Creating volume 55917814-0a34-4615-942a-b7ae4044161c {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:35 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:35 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c 1073741824 Apr 16 14:39:35 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:35 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f" returned: 0 in 0.603s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:35 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-2cd7a9e8-716f-4347-9fdc-29174c95b1e4 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5', 'name': 'volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e7b8306-b763-4c0c-b5fb-587958aa9bf4', 'enforce_multipath': True} {{(pid=83305) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 14:39:35 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f Apr 16 14:39:35 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:35 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-4b1a9c43-417a-4d97-af71-ff24c2104f87 req-2cd7a9e8-716f-4347-9fdc-29174c95b1e4 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] attachment_update completed successfully. Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Flow 'volume_create_manager' (06ed834b-de5c-47d1-a03c-b64b389b4d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22afd307-4ee9-4d1a-8f70-ce47c9c43331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22afd307-4ee9-4d1a-8f70-ce47c9c43331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-621156669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d988a8f6-d920-46c5-9095-5666351f942c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3a5004d7f94690819dde16aca5ea08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:36Z,use_quota=True,user_id='f6889f53d2174be49f65c81d292a5a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ee0333-fa5c-4f7c-88a9-0f09133a153e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ee0333-fa5c-4f7c-88a9-0f09133a153e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40db67d6-ee38-4bb2-90c7-a38ed5eb661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40db67d6-ee38-4bb2-90c7-a38ed5eb661c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd988a8f6-d920-46c5-9095-5666351f942c', 'volume_name': 'volume-d988a8f6-d920-46c5-9095-5666351f942c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27af1f78-a9db-4681-9a86-9b78bc375c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27af1f78-a9db-4681-9a86-9b78bc375c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c93a08-133a-4ab6-a413-69edfefb626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:36 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Volume d988a8f6-d920-46c5-9095-5666351f942c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d988a8f6-d920-46c5-9095-5666351f942c', 'volume_size': 1} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:36 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c 1073741824" returned: 0 in 0.625s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:36 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a654524a-9fe9-44e3-a819-3bde3885fb9f" returned: 0 in 0.591s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:36 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Lock "cinder-quobyte-a654524a-9fe9-44e3-a819-3bde3885fb9f" released by "delete_volume" :: held 1.220s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:36 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Created reservations ['a25fbb5e-a184-4ecc-9d50-1fe594d4fc01'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:36 devstack cinder-volume[83305]: WARNING cinder.quota [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-748043205 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-748043205, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:39:36 devstack cinder-volume[83305]: WARNING cinder.quota [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-748043205 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-748043205, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Created reservations ['92feac37-88ec-458b-ac83-ca832ea568b7', '35bfb197-fda9-482d-ba65-6ba0ee3e1ef2', '406bb6b5-7aac-47ce-9368-60f78995cebd', '34732864-a78b-42ea-b55d-c782be6588ce'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Created reservations ['29c445e7-a782-4ec3-b7e8-0de6179fa3fb', '0a954fdd-0678-4bdb-b4c2-f55ec12c2b44', 'd96d8da7-31aa-4936-94c6-3932ee17ea6a', '24cc3fbc-29b3-49f2-a07a-23bcf2777507'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:36 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:36 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:36 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c" returned: 0 in 0.485s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-621156669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d988a8f6-d920-46c5-9095-5666351f942c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3a5004d7f94690819dde16aca5ea08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:36Z,use_quota=True,user_id='f6889f53d2174be49f65c81d292a5a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Creating volume d988a8f6-d920-46c5-9095-5666351f942c {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:36 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:36 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c 1073741824 Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8063a250-2304-4573-b729-b499fa2bcf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55917814-0a34-4615-942a-b7ae4044161c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:36 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcda30ac-890c-43a2-be30-f190399a2895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:36 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Volume volume-55917814-0a34-4615-942a-b7ae4044161c (55917814-0a34-4615-942a-b7ae4044161c): created successfully Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcda30ac-890c-43a2-be30-f190399a2895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Flow 'volume_create_manager' (808708a2-6e1a-4f9d-8f9b-c84863160f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:36 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-fecf9bea-600d-4906-ac9a-e856b0c8bd4e tempest-VolumesCloneTest-1242123673 None] Created volume successfully. Apr 16 14:39:37 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.492s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:37 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:37 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e249c792-ef7a-4da6-9664-ca61da505300 tempest-GroupsTest-188325168 None] Delete group completed successfully. Apr 16 14:39:37 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c 1073741824" returned: 0 in 0.530s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:37 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c Apr 16 14:39:37 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:37 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c" returned: 0 in 0.484s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c93a08-133a-4ab6-a413-69edfefb626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d988a8f6-d920-46c5-9095-5666351f942c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3379a7e-9078-4e2f-9dbd-89d97a56e969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:37 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Volume volume-d988a8f6-d920-46c5-9095-5666351f942c (d988a8f6-d920-46c5-9095-5666351f942c): created successfully Apr 16 14:39:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3379a7e-9078-4e2f-9dbd-89d97a56e969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Flow 'volume_create_manager' (06ed834b-de5c-47d1-a03c-b64b389b4d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:37 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-34d08981-8aa4-44db-9252-431ad6b879f6 tempest-VolumesListAdminTestJSON-579732498 None] Created volume successfully. Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Flow 'volume_create_manager' (60a15773-53cb-4191-9694-c6b0e210bdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a40e92e-a296-4763-80d2-396915cbd646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a40e92e-a296-4763-80d2-396915cbd646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-466584928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d22cb1-d84d-4f52-ba02-9f056f2df94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96fe9e76dc6486a93428d99e6b13d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=55917814-0a34-4615-942a-b7ae4044161c,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:38Z,use_quota=True,user_id='5721a0dff51a44e7bb87cf67765ab398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abafc53e-c532-4e48-984d-4e633ff6ec3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abafc53e-c532-4e48-984d-4e633ff6ec3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e35fbb-9eca-4663-bb92-a719d9b8af5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e35fbb-9eca-4663-bb92-a719d9b8af5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '85d22cb1-d84d-4f52-ba02-9f056f2df94c', 'volume_name': 'volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c', 'volume_size': 2, 'source_volid': '55917814-0a34-4615-942a-b7ae4044161c', 'source_volstatus': 'available'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3d0cf1-b86f-41ed-9495-425194b69560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3d0cf1-b86f-41ed-9495-425194b69560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6e0583-1c6f-4bc7-be22-69674f5569aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:38 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Volume 85d22cb1-d84d-4f52-ba02-9f056f2df94c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c', 'volume_size': 2, 'source_volid': '55917814-0a34-4615-942a-b7ae4044161c', 'source_volstatus': 'available'} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:38 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Cloning volume 55917814-0a34-4615-942a-b7ae4044161c to volume 85d22cb1-d84d-4f52-ba02-9f056f2df94c Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Creating offline snapshot a408785a-6d1a-42ef-b608-050d9b2f005e of volume 55917814-0a34-4615-942a-b7ae4044161c {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abfd609-f166-44f7-9182-5ea60660bd4c]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:38 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c Apr 16 14:39:38 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Flow 'volume_create_manager' (61c2a093-82d9-4fa4-9484-87a359c0459e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc1a580-3569-488d-9f7a-fe184b48f0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc1a580-3569-488d-9f7a-fe184b48f0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1181105825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72358605-dd41-437b-8998-a7a7f6561830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3a5004d7f94690819dde16aca5ea08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:39Z,use_quota=True,user_id='f6889f53d2174be49f65c81d292a5a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e8c7e6-56f9-4e28-b06b-64f3e2f6ce63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e8c7e6-56f9-4e28-b06b-64f3e2f6ce63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd2b080-cb6f-4ac2-aa98-3024a16871af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd2b080-cb6f-4ac2-aa98-3024a16871af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72358605-dd41-437b-8998-a7a7f6561830', 'volume_name': 'volume-72358605-dd41-437b-8998-a7a7f6561830', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8792970d-f24d-4526-aa97-430aacbeae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8792970d-f24d-4526-aa97-430aacbeae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a81326d-2eaf-4ae2-ab74-3ab2170ba7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:38 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Volume 72358605-dd41-437b-8998-a7a7f6561830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72358605-dd41-437b-8998-a7a7f6561830', 'volume_size': 1} Apr 16 14:39:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:39 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c" returned: 0 in 0.627s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:39 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e 1G Apr 16 14:39:39 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:39 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e 1G" returned: 0 in 0.517s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55917814-0a34-4615-942a-b7ae4044161c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:39 devstack sudo[87476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55917814-0a34-4615-942a-b7ae4044161c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e Apr 16 14:39:39 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:40 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55917814-0a34-4615-942a-b7ae4044161c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e" returned: 0 in 0.464s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:40 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e is being set with open permissions: ugo+rw Apr 16 14:39:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:40 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e Apr 16 14:39:40 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:40 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e" returned: 0 in 0.571s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:40 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.info Apr 16 14:39:40 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:41 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.info" returned: 0 in 0.629s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:41 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.info is being set with open permissions: ugo+rw Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:41 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.info Apr 16 14:39:41 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:41 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.info" returned: 0 in 0.568s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Acquiring lock "cinder-quobyte-85d22cb1-d84d-4f52-ba02-9f056f2df94c" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Lock "cinder-quobyte-85d22cb1-d84d-4f52-ba02-9f056f2df94c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] snapshot: a408785a-6d1a-42ef-b608-050d9b2f005e, volume: 85d22cb1-d84d-4f52-ba02-9f056f2df94c, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaa1e71-ec8e-4f06-8274-72df6a669f07]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:42 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e Apr 16 14:39:42 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:42 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e" returned: 0 in 0.759s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55917814-0a34-4615-942a-b7ae4044161c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:39:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:39:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:39:42 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fada4ced-2115-46f4-8bc0-f74283009c32]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:42 devstack sudo[87528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c Apr 16 14:39:42 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:43 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c" returned: 0 in 0.904s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:43 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:39:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:43 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c Apr 16 14:39:43 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG oslo_service.periodic_task [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:46 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:46 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:46 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c" returned: 0 in 2.971s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82c4b57-17fc-422f-8a14-1a6b7cac91c1]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:46 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c Apr 16 14:39:46 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:46 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.463s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:46 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:47 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c" returned: 0 in 0.865s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:47 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c, size 1024.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:39:47 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Converted 1024.00 MB image at 344.45 MB/s Apr 16 14:39:47 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c is being set with open permissions: ugo+rw Apr 16 14:39:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:47 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c Apr 16 14:39:47 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:48 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c" returned: 0 in 0.507s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Lock "cinder-quobyte-85d22cb1-d84d-4f52-ba02-9f056f2df94c" released by "_copy_volume_from_snapshot" :: held 6.115s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Acquiring lock "cinder-quobyte-a408785a-6d1a-42ef-b608-050d9b2f005e" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Lock "cinder-quobyte-a408785a-6d1a-42ef-b608-050d9b2f005e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Deleting offline snapshot a408785a-6d1a-42ef-b608-050d9b2f005e of volume 55917814-0a34-4615-942a-b7ae4044161c {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] snapshot_file for this snap is: volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7942ab-efed-4645-b1aa-92789ed37359]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:48 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e Apr 16 14:39:48 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:48 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e" returned: 0 in 0.731s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55917814-0a34-4615-942a-b7ae4044161c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a83a44f-2db6-44b3-b247-fd0c7fcf3cd3]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:48 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c Apr 16 14:39:48 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:49 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c" returned: 0 in 0.533s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:49 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e Apr 16 14:39:49 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:49 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e" returned: 0 in 0.586s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:50 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e Apr 16 14:39:50 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Flow 'volume_create_manager' (3b11720e-dd30-4424-b3c5-a474b863b9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153be9ba-4bcd-4761-b983-672b757c580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153be9ba-4bcd-4761-b983-672b757c580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1644071879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4e7d68-632e-497d-865d-726fdfba1a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4b683591c646889c047d0821397f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:50Z,use_quota=True,user_id='95d3c01cc6f540a0a6cd7c45914a167f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6618307-c998-485c-abf0-595b42940289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6618307-c998-485c-abf0-595b42940289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adcde24e-bd0e-49df-a9ee-aeebb800e288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adcde24e-bd0e-49df-a9ee-aeebb800e288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4e7d68-632e-497d-865d-726fdfba1a1e', 'volume_name': 'volume-2b4e7d68-632e-497d-865d-726fdfba1a1e', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2727b5-3f4a-42f4-98f7-85a078cf899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2727b5-3f4a-42f4-98f7-85a078cf899c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d7fa37-09a3-4859-b4b1-a04c4e1526a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:50 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Volume 2b4e7d68-632e-497d-865d-726fdfba1a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4e7d68-632e-497d-865d-726fdfba1a1e', 'volume_size': 1} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:50 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c.a408785a-6d1a-42ef-b608-050d9b2f005e" returned: 0 in 0.447s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Lock "cinder-quobyte-a408785a-6d1a-42ef-b608-050d9b2f005e" released by "_delete_snapshot" :: held 2.414s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.059s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.742s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1181105825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72358605-dd41-437b-8998-a7a7f6561830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3a5004d7f94690819dde16aca5ea08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:39Z,use_quota=True,user_id='f6889f53d2174be49f65c81d292a5a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Creating volume 72358605-dd41-437b-8998-a7a7f6561830 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:50 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6e0583-1c6f-4bc7-be22-69674f5569aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c', 'volume_size': 2, 'source_volid': '55917814-0a34-4615-942a-b7ae4044161c', 'source_volstatus': 'available'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:50 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830 1073741824 Apr 16 14:39:50 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b821c04e-0a72-41c2-83d8-1f2f06fe9438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:50 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Volume volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c (85d22cb1-d84d-4f52-ba02-9f056f2df94c): created successfully Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b821c04e-0a72-41c2-83d8-1f2f06fe9438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Flow 'volume_create_manager' (60a15773-53cb-4191-9694-c6b0e210bdf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:50 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b03a57b0-032a-4292-814b-93d122d5fe5e tempest-VolumesCloneTest-1242123673 None] Created volume successfully. Apr 16 14:39:50 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830 1073741824" returned: 0 in 0.484s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:51 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830 Apr 16 14:39:51 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Acquiring lock "cinder-85d22cb1-d84d-4f52-ba02-9f056f2df94c-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:51 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Lock "cinder-85d22cb1-d84d-4f52-ba02-9f056f2df94c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830" returned: 0 in 0.444s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1644071879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4e7d68-632e-497d-865d-726fdfba1a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4b683591c646889c047d0821397f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:50Z,use_quota=True,user_id='95d3c01cc6f540a0a6cd7c45914a167f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Creating volume 2b4e7d68-632e-497d-865d-726fdfba1a1e {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:51 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a81326d-2eaf-4ae2-ab74-3ab2170ba7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72358605-dd41-437b-8998-a7a7f6561830', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db319121-c132-4c56-bbba-d8cc10d37031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:51 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e 1073741824 Apr 16 14:39:51 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Acquiring lock "cinder-quobyte-85d22cb1-d84d-4f52-ba02-9f056f2df94c" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:51 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Volume volume-72358605-dd41-437b-8998-a7a7f6561830 (72358605-dd41-437b-8998-a7a7f6561830): created successfully Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db319121-c132-4c56-bbba-d8cc10d37031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Flow 'volume_create_manager' (61c2a093-82d9-4fa4-9484-87a359c0459e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:51 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-0047bae4-a937-4aee-95d9-6f34e62359b3 tempest-VolumesListAdminTestJSON-579732498 None] Created volume successfully. Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Lock "cinder-quobyte-85d22cb1-d84d-4f52-ba02-9f056f2df94c" acquired by "delete_volume" :: waited 0.024s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e0b814-b4cd-4608-8f69-9dc2d7d88a03]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:51 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c Apr 16 14:39:51 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Flow 'volume_create_manager' (ddc339fd-b19a-46ef-95e1-85a0736f2395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823244e3-f30f-4ba1-985b-e6d35eb61686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823244e3-f30f-4ba1-985b-e6d35eb61686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1793377166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3a5004d7f94690819dde16aca5ea08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:52Z,use_quota=True,user_id='f6889f53d2174be49f65c81d292a5a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97faa35a-2815-421a-8831-d17d66b9c8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97faa35a-2815-421a-8831-d17d66b9c8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0895f44a-3cc5-4dcd-a351-9596471a724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0895f44a-3cc5-4dcd-a351-9596471a724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1', 'volume_name': 'volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5e76dd-2ffa-405c-a3fd-616acd8609b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5e76dd-2ffa-405c-a3fd-616acd8609b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c8d901-f82d-46f2-8fc3-127a3fec7906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:51 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Volume ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1', 'volume_size': 1} Apr 16 14:39:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:52 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e 1073741824" returned: 0 in 0.571s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:52 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c" returned: 0 in 0.526s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:52 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e Apr 16 14:39:52 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:52 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c Apr 16 14:39:52 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:52 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-85d22cb1-d84d-4f52-ba02-9f056f2df94c" returned: 0 in 0.419s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Lock "cinder-quobyte-85d22cb1-d84d-4f52-ba02-9f056f2df94c" released by "delete_volume" :: held 0.968s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:52 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e" returned: 0 in 0.475s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.543s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1793377166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3a5004d7f94690819dde16aca5ea08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:52Z,use_quota=True,user_id='f6889f53d2174be49f65c81d292a5a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Creating volume ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:52 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Created reservations ['6a35ba58-0182-4f78-88d2-c7d16609615d', '9b5ebfa4-c46c-4771-b9ad-7840cde6089b', '942827b2-a392-4c8d-ad4d-c4adf369a34c', 'c76d28a5-6019-4b75-8019-d13f1302d663'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:52 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1 1073741824 Apr 16 14:39:52 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d7fa37-09a3-4859-b4b1-a04c4e1526a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4e7d68-632e-497d-865d-726fdfba1a1e', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9286f1e-760e-4054-947d-69941f42be74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:52 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Volume volume-2b4e7d68-632e-497d-865d-726fdfba1a1e (2b4e7d68-632e-497d-865d-726fdfba1a1e): created successfully Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9286f1e-760e-4054-947d-69941f42be74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Flow 'volume_create_manager' (3b11720e-dd30-4424-b3c5-a474b863b9af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:52 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e9a04e80-c1fe-4886-91cb-48f378a0d858 tempest-VolumeQuotasAdminTestJSON-940504011 None] Created volume successfully. Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:52 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:52 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:53 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:53 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.425s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1 1073741824" returned: 0 in 0.533s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:53 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Deleted volume successfully. Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40c38add-f165-4a36-a9ed-6a9169422475 tempest-VolumesCloneTest-1242123673 None] Lock "cinder-85d22cb1-d84d-4f52-ba02-9f056f2df94c-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:53 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1 Apr 16 14:39:53 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Acquiring lock "cinder-2b4e7d68-632e-497d-865d-726fdfba1a1e-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "cinder-2b4e7d68-632e-497d-865d-726fdfba1a1e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Acquiring lock "cinder-quobyte-2b4e7d68-632e-497d-865d-726fdfba1a1e" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "cinder-quobyte-2b4e7d68-632e-497d-865d-726fdfba1a1e" acquired by "delete_volume" :: waited 0.021s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7265ebe3-352f-4365-a402-64d48d50040b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:53 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:53 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e Apr 16 14:39:53 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1" returned: 0 in 0.453s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c8d901-f82d-46f2-8fc3-127a3fec7906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5152f3ab-4e99-4742-8845-04ebdf49ea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:53 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Volume volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1 (ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1): created successfully Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5152f3ab-4e99-4742-8845-04ebdf49ea8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Flow 'volume_create_manager' (ddc339fd-b19a-46ef-95e1-85a0736f2395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:53 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e243320e-a961-4e03-9228-2933f8692957 tempest-VolumesListAdminTestJSON-579732498 None] Created volume successfully. Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Acquiring lock "cinder-55917814-0a34-4615-942a-b7ae4044161c-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Lock "cinder-55917814-0a34-4615-942a-b7ae4044161c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Acquiring lock "cinder-quobyte-55917814-0a34-4615-942a-b7ae4044161c" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Lock "cinder-quobyte-55917814-0a34-4615-942a-b7ae4044161c" acquired by "delete_volume" :: waited 0.017s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[884f2a72-1b5f-4a31-90fd-df335bf02606]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:53 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c Apr 16 14:39:53 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:53 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e" returned: 0 in 0.545s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:54 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e Apr 16 14:39:54 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:54 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c" returned: 0 in 0.514s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:54 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c Apr 16 14:39:54 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Flow 'volume_create_manager' (dccbd06c-c506-4f6b-9e01-5c6305a462c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065d64a4-7802-4d8e-91cd-ccbf152b74ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065d64a4-7802-4d8e-91cd-ccbf152b74ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec67159-ad98-4188-8c60-a137328a72e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024e5b96d7e244c78292f52216d1df76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:54Z,use_quota=True,user_id='62b8cc142cf14fe18fc69e50a50b5fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd05d51-207f-4d91-8523-81015affcf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd05d51-207f-4d91-8523-81015affcf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b0f9a9-9bd5-47cb-801f-edde77c839d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b0f9a9-9bd5-47cb-801f-edde77c839d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec67159-ad98-4188-8c60-a137328a72e3', 'volume_name': 'volume-7ec67159-ad98-4188-8c60-a137328a72e3', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ece986-e936-43aa-b9f7-cc00dec33b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ece986-e936-43aa-b9f7-cc00dec33b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14bd6e8-97d3-44f3-8961-ae0302ce59f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:54 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Volume 7ec67159-ad98-4188-8c60-a137328a72e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec67159-ad98-4188-8c60-a137328a72e3', 'volume_size': 1} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec67159-ad98-4188-8c60-a137328a72e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024e5b96d7e244c78292f52216d1df76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:54Z,use_quota=True,user_id='62b8cc142cf14fe18fc69e50a50b5fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Creating volume 7ec67159-ad98-4188-8c60-a137328a72e3 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:54 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:54 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3 1073741824 Apr 16 14:39:54 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:54 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2b4e7d68-632e-497d-865d-726fdfba1a1e" returned: 0 in 0.840s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "cinder-quobyte-2b4e7d68-632e-497d-865d-726fdfba1a1e" released by "delete_volume" :: held 1.412s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Created reservations ['111c7521-9f50-453e-8576-222e49f90c56', 'c7aac8c5-863f-45b1-a39b-fba9d5211cea', 'ddbe468f-aad6-4f11-9432-a09ea3f2ceae', 'a134dd30-bbc8-493a-aaf6-736fe3c15f9f'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:54 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-55917814-0a34-4615-942a-b7ae4044161c" returned: 0 in 0.754s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Lock "cinder-quobyte-55917814-0a34-4615-942a-b7ae4044161c" released by "delete_volume" :: held 1.331s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:55 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:55 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Created reservations ['86933347-cb11-4e14-8047-a9f74b7ee5f4', 'd39d8cea-38ed-44c5-99c9-2b6890b74982', 'dfd6c2ce-811f-4195-a96b-9cc88dc10979', '0962c7f4-2654-43f9-9bb6-3b9a899c61bd'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:55 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:55 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:55 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3 1073741824" returned: 0 in 0.883s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:55 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3 Apr 16 14:39:55 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:55 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.546s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:55 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Deleted volume successfully. Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e28b2573-a2e3-4255-ad25-e161adc03389 tempest-VolumesCloneTest-1242123673 None] Lock "cinder-55917814-0a34-4615-942a-b7ae4044161c-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:55 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.751s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:55 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Deleted volume successfully. Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ed9c138b-493d-4b14-818b-a7d130555d7b tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "cinder-2b4e7d68-632e-497d-865d-726fdfba1a1e-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:55 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Flow 'volume_create_manager' (82863ac3-54fa-46f6-86fb-ed581a8aa93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6b5e9b-36b4-43e7-b276-64efb1a21028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6b5e9b-36b4-43e7-b276-64efb1a21028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1767420032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1ba9b4-366d-42c3-8c59-1371326cb43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4b683591c646889c047d0821397f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:56Z,use_quota=True,user_id='95d3c01cc6f540a0a6cd7c45914a167f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961c4c23-1c3f-4005-9a00-7bfc8961d630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961c4c23-1c3f-4005-9a00-7bfc8961d630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca97c1fe-6661-4133-897b-80b4f1bbd4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca97c1fe-6661-4133-897b-80b4f1bbd4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1ba9b4-366d-42c3-8c59-1371326cb43d', 'volume_name': 'volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a9967c-3df1-4bcc-bf8a-06718c85d12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a9967c-3df1-4bcc-bf8a-06718c85d12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f5d6ac-32c8-415d-86c6-93ff9427d3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:56 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Volume 7b1ba9b4-366d-42c3-8c59-1371326cb43d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d', 'volume_size': 1} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:56 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3" returned: 0 in 0.612s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.117s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1767420032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1ba9b4-366d-42c3-8c59-1371326cb43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4b683591c646889c047d0821397f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:39:56Z,use_quota=True,user_id='95d3c01cc6f540a0a6cd7c45914a167f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Creating volume 7b1ba9b4-366d-42c3-8c59-1371326cb43d {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:39:56 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14bd6e8-97d3-44f3-8961-ae0302ce59f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec67159-ad98-4188-8c60-a137328a72e3', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:56 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d 1073741824 Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681c04d6-4f73-437f-98e8-be2d1a16af77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:56 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:56 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Volume volume-7ec67159-ad98-4188-8c60-a137328a72e3 (7ec67159-ad98-4188-8c60-a137328a72e3): created successfully Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681c04d6-4f73-437f-98e8-be2d1a16af77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Flow 'volume_create_manager' (dccbd06c-c506-4f6b-9e01-5c6305a462c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:56 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-31bd22a1-fbdf-4f55-bae3-f15e265c0bfe tempest-VolumesListAdminTestJSON-849657969 None] Created volume successfully. Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Acquiring lock "cinder-7ec67159-ad98-4188-8c60-a137328a72e3-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Lock "cinder-7ec67159-ad98-4188-8c60-a137328a72e3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:56 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d 1073741824" returned: 0 in 0.726s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Acquiring lock "cinder-quobyte-7ec67159-ad98-4188-8c60-a137328a72e3" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Lock "cinder-quobyte-7ec67159-ad98-4188-8c60-a137328a72e3" acquired by "delete_volume" :: waited 0.040s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc29d97c-107e-4c71-982f-221e8756d332]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "cinder-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:57 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3 Apr 16 14:39:57 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d Apr 16 14:39:57 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:57 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "cinder-quobyte-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-quobyte-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfec628-bbc2-49f8-9596-fab8e78a5090]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:57 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1 Apr 16 14:39:57 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:57 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3" returned: 0 in 0.681s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:57 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d" returned: 0 in 0.674s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:39:57 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3 Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:57 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f5d6ac-32c8-415d-86c6-93ff9427d3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a336799-e1fa-40ae-bd6b-95e8e0b1045e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:39:57 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Volume volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d (7b1ba9b4-366d-42c3-8c59-1371326cb43d): created successfully Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a336799-e1fa-40ae-bd6b-95e8e0b1045e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Flow 'volume_create_manager' (82863ac3-54fa-46f6-86fb-ed581a8aa93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:39:57 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e3a89bcd-18de-48b9-b4c3-7aa655cd5f12 tempest-VolumeQuotasAdminTestJSON-940504011 None] Created volume successfully. Apr 16 14:39:57 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1" returned: 0 in 0.813s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:58 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1 Apr 16 14:39:58 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:58 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7ec67159-ad98-4188-8c60-a137328a72e3" returned: 0 in 0.774s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Lock "cinder-quobyte-7ec67159-ad98-4188-8c60-a137328a72e3" released by "delete_volume" :: held 1.487s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Created reservations ['e0404fde-117e-43ac-ab30-a7447ad6e302', 'bb0d3167-9875-4d9b-a49d-aad07d676671', 'f7d869cc-4f60-4e4c-875a-11aa23b2607f', '47fcce63-3997-4c65-910d-4d41b298488d'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:58 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:58 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:58 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1" returned: 0 in 0.722s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-quobyte-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1" released by "delete_volume" :: held 1.562s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Created reservations ['f466bddb-8b29-4346-adb7-e7d4736901f7', 'fd287269-7880-4380-8efc-c014f3465ba9', 'e3606f4e-958d-42c8-90af-8049705d8df0', '05a28b0b-c5d3-48b3-8c1d-18e70396c079'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:39:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:58 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:39:58 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:58 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-1f881c5c-74ee-4df6-a558-76cf97fde27c tempest-VolumeQuotasAdminTestJSON-326497997 None] Transfer volume completed successfully. Apr 16 14:39:59 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.578s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:59 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Deleted volume successfully. Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08c93e3f-90fe-4070-8dcd-a8eeed8ba645 tempest-VolumesListAdminTestJSON-849657969 None] Lock "cinder-7ec67159-ad98-4188-8c60-a137328a72e3-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "cinder-72358605-dd41-437b-8998-a7a7f6561830-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-72358605-dd41-437b-8998-a7a7f6561830-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "cinder-quobyte-72358605-dd41-437b-8998-a7a7f6561830" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-quobyte-72358605-dd41-437b-8998-a7a7f6561830" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[97889824-4ad0-4e00-8e03-8b64843eb335]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:39:59 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.776s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:39:59 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Deleted volume successfully. Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-047f99b9-77cf-4f6e-87ac-f4294b4d1567 tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-ad6d3cf3-9cba-4de9-b0ed-b0c645b39cf1-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:39:59 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830 Apr 16 14:39:59 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Acquiring lock "cinder-7b1ba9b4-366d-42c3-8c59-1371326cb43d-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Lock "cinder-7b1ba9b4-366d-42c3-8c59-1371326cb43d-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Acquiring lock "cinder-quobyte-7b1ba9b4-366d-42c3-8c59-1371326cb43d" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Lock "cinder-quobyte-7b1ba9b4-366d-42c3-8c59-1371326cb43d" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c90319c-b463-4598-b0b6-da58744d6001]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:39:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:00 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d Apr 16 14:40:00 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:00 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830" returned: 0 in 0.779s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:00 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830 Apr 16 14:40:00 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:00 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-72358605-dd41-437b-8998-a7a7f6561830" returned: 0 in 0.714s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-quobyte-72358605-dd41-437b-8998-a7a7f6561830" released by "delete_volume" :: held 1.525s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Created reservations ['892eef4b-ee41-432f-af56-876225d90346', '3ece8dc0-9060-41ae-9cad-48979b79807a', '46837a66-ff09-45b8-8963-f65d57b2a470', 'eaf7b31f-706d-4201-ba49-4bb74740b87a'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:01 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d" returned: 0 in 1.131s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:01 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d Apr 16 14:40:01 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:01 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:01 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Flow 'volume_create_manager' (2b16329f-b2ea-47a6-ac41-24c98667637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee883fa-9da5-439c-9341-bec3604fe672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee883fa-9da5-439c-9341-bec3604fe672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-94218242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71a7060418864e5ab7f22dbe352d7d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:01Z,use_quota=True,user_id='aa8dfaf306e04f6d99ccb53fdf39a951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafaf1c0-2bdd-4559-8dc8-b200f29d2686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafaf1c0-2bdd-4559-8dc8-b200f29d2686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e78b42c-014b-4fb3-a509-40c32ad94c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e78b42c-014b-4fb3-a509-40c32ad94c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f', 'volume_name': 'volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa83d0d-a52f-421d-8949-6e1566d7ae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa83d0d-a52f-421d-8949-6e1566d7ae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f313b1e-2de3-4dd6-9211-db4fb0364010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:01 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Volume f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f', 'volume_size': 1} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-94218242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71a7060418864e5ab7f22dbe352d7d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:01Z,use_quota=True,user_id='aa8dfaf306e04f6d99ccb53fdf39a951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Creating volume f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:01 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:01 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f 1073741824 Apr 16 14:40:01 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "cinder-d988a8f6-d920-46c5-9095-5666351f942c-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:01 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-d988a8f6-d920-46c5-9095-5666351f942c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:01 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b1ba9b4-366d-42c3-8c59-1371326cb43d" returned: 0 in 0.732s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.701s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Lock "cinder-quobyte-7b1ba9b4-366d-42c3-8c59-1371326cb43d" released by "delete_volume" :: held 1.901s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:01 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Deleted volume successfully. Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "cinder-quobyte-d988a8f6-d920-46c5-9095-5666351f942c" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10b03cf2-51e8-4115-9da8-162f40903d8f tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-72358605-dd41-437b-8998-a7a7f6561830-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-quobyte-d988a8f6-d920-46c5-9095-5666351f942c" acquired by "delete_volume" :: waited 0.019s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Created reservations ['0c104f0c-778c-4569-b565-86e15858f4e7', 'aec04c91-2489-4a01-8c99-4609d30f8718', '4ad95eaa-ca08-44fc-898a-96c35adad049', '0951fc2a-72ff-47b4-869f-61e7a8daaa18'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f530b600-48d2-40c6-a8d6-d09e27e01413]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:02 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:02 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:02 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c Apr 16 14:40:02 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:02 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f 1073741824" returned: 0 in 0.696s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:02 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f Apr 16 14:40:02 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:02 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.854s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:02 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:02 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Deleted volume successfully. Apr 16 14:40:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-19f907f4-27d3-4585-9fad-dcf41c215842 tempest-VolumeQuotasAdminTestJSON-1091493562 None] Lock "cinder-7b1ba9b4-366d-42c3-8c59-1371326cb43d-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:02 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f" returned: 0 in 0.770s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:02 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f313b1e-2de3-4dd6-9211-db4fb0364010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa7b7c0-4248-4d07-becc-124c9bbf06fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:02 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Volume volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f (f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f): created successfully Apr 16 14:40:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa7b7c0-4248-4d07-becc-124c9bbf06fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Flow 'volume_create_manager' (2b16329f-b2ea-47a6-ac41-24c98667637c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:03 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-894407c6-e5aa-4ce0-be68-887f71613e7b tempest-VolumesListTestJSON-2086992845 None] Created volume successfully. Apr 16 14:40:03 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c" returned: 0 in 1.111s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:03 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c Apr 16 14:40:03 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:03 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d988a8f6-d920-46c5-9095-5666351f942c" returned: 0 in 0.483s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-quobyte-d988a8f6-d920-46c5-9095-5666351f942c" released by "delete_volume" :: held 1.626s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Created reservations ['78687eee-cdc0-4adc-bffe-00fb14cbd522', '1dd04dfd-a3cc-4631-aa69-7811dc2095eb', 'af3b05eb-6359-42eb-8ec9-b65367421b60', 'bc816402-6c94-43d9-848f-4b2619a13e3b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:03 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:03 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Flow 'volume_create_manager' (9c8a9bea-9827-411f-ab2c-ccccbc4bb272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a57c648-9ecc-4ce3-9344-0dee9927beda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a57c648-9ecc-4ce3-9344-0dee9927beda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-577238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd8e2e2-efbe-42a5-ba63-1448a7a33682,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71a7060418864e5ab7f22dbe352d7d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:04Z,use_quota=True,user_id='aa8dfaf306e04f6d99ccb53fdf39a951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dceb6edf-6cb3-41ad-a01e-557652e42b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dceb6edf-6cb3-41ad-a01e-557652e42b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df70109b-1b5c-4c49-92f8-7b12e028512d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df70109b-1b5c-4c49-92f8-7b12e028512d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd8e2e2-efbe-42a5-ba63-1448a7a33682', 'volume_name': 'volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51267d7-8003-473c-ad17-5475009ab353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51267d7-8003-473c-ad17-5475009ab353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aaea116-453d-4e05-8ff8-cd4a8af80a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:04 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Volume 4dd8e2e2-efbe-42a5-ba63-1448a7a33682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682', 'volume_size': 1} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-577238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd8e2e2-efbe-42a5-ba63-1448a7a33682,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71a7060418864e5ab7f22dbe352d7d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:04Z,use_quota=True,user_id='aa8dfaf306e04f6d99ccb53fdf39a951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Creating volume 4dd8e2e2-efbe-42a5-ba63-1448a7a33682 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:04 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:04 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682 1073741824 Apr 16 14:40:04 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:04 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.545s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:04 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Deleted volume successfully. Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-de7c3704-18ae-4fb7-bc3e-b085bec27a93 tempest-VolumesListAdminTestJSON-579732498 None] Lock "cinder-d988a8f6-d920-46c5-9095-5666351f942c-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:04 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682 1073741824" returned: 0 in 0.734s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:04 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682 Apr 16 14:40:04 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:05 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682" returned: 0 in 0.533s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aaea116-453d-4e05-8ff8-cd4a8af80a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992c8ad5-b3f7-42bb-8a73-0bbd832dc60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:05 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Volume volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682 (4dd8e2e2-efbe-42a5-ba63-1448a7a33682): created successfully Apr 16 14:40:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992c8ad5-b3f7-42bb-8a73-0bbd832dc60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Flow 'volume_create_manager' (9c8a9bea-9827-411f-ab2c-ccccbc4bb272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:05 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-464d0789-c9a4-40d1-9c1d-9615b1e37779 tempest-VolumesListTestJSON-2086992845 None] Created volume successfully. Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Flow 'volume_create_manager' (0c77e9df-ba0b-4d46-8d0b-26bb8f5f3e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a0cee5-b866-406c-b14b-0e446b7f4577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a0cee5-b866-406c-b14b-0e446b7f4577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1115263798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53433fe9-1cff-405e-a755-9db415d9b9f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71a7060418864e5ab7f22dbe352d7d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:06Z,use_quota=True,user_id='aa8dfaf306e04f6d99ccb53fdf39a951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b123d8c7-07fc-4990-b27d-d0eb6ce46da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b123d8c7-07fc-4990-b27d-d0eb6ce46da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadd3849-0d33-45b2-b1e2-eaf824959f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadd3849-0d33-45b2-b1e2-eaf824959f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53433fe9-1cff-405e-a755-9db415d9b9f5', 'volume_name': 'volume-53433fe9-1cff-405e-a755-9db415d9b9f5', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7eed758-7da1-4f23-8c33-99ff7b21561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7eed758-7da1-4f23-8c33-99ff7b21561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da6da01-d88e-4b99-b442-a608b8d50a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:06 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Volume 53433fe9-1cff-405e-a755-9db415d9b9f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53433fe9-1cff-405e-a755-9db415d9b9f5', 'volume_size': 1} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1115263798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53433fe9-1cff-405e-a755-9db415d9b9f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71a7060418864e5ab7f22dbe352d7d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:06Z,use_quota=True,user_id='aa8dfaf306e04f6d99ccb53fdf39a951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Creating volume 53433fe9-1cff-405e-a755-9db415d9b9f5 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:06 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:06 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5 1073741824 Apr 16 14:40:06 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:06 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-6a8d849a-84e0-45f5-aafe-9a7176147915 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Terminate volume connection completed successfully. Apr 16 14:40:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-6a8d849a-84e0-45f5-aafe-9a7176147915 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Deleting attachment 5e7b8306-b763-4c0c-b5fb-587958aa9bf4. {{(pid=83305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 14:40:07 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5 1073741824" returned: 0 in 0.616s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:07 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5 Apr 16 14:40:07 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "cinder-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "cinder-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "cinder-quobyte-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "cinder-quobyte-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4df8f6-3294-46fa-b26d-25aec951a896]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:07 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5" returned: 0 in 0.655s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:07 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab Apr 16 14:40:07 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da6da01-d88e-4b99-b442-a608b8d50a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53433fe9-1cff-405e-a755-9db415d9b9f5', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6187c17f-8a9f-4cbf-8cd0-cdb0b002488d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:07 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Volume volume-53433fe9-1cff-405e-a755-9db415d9b9f5 (53433fe9-1cff-405e-a755-9db415d9b9f5): created successfully Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6187c17f-8a9f-4cbf-8cd0-cdb0b002488d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Flow 'volume_create_manager' (0c77e9df-ba0b-4d46-8d0b-26bb8f5f3e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:07 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b2c37a96-c540-416e-b225-ffa2b43bbd24 tempest-VolumesListTestJSON-2086992845 None] Created volume successfully. Apr 16 14:40:08 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" returned: 0 in 0.642s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:08 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab Apr 16 14:40:08 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:09 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" returned: 1 in 0.811s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:09 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab Apr 16 14:40:09 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:09 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" returned: 0 in 0.630s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "cinder-quobyte-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab" released by "delete_volume" :: held 2.135s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG cinder.quota [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Created reservations ['c072ab39-5112-41fd-862e-3ed9e767e9a8', '48e644b5-ffe0-42b8-8d17-fdd55af27f5d', '4cf693ea-2236-46bc-899e-0841ff11568b', '6f10f893-ba68-4aba-9064-2d76e9d37ea7'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:09 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:09 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:10 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.551s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:10 devstack cinder-volume[83305]: DEBUG cinder.manager [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:10 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Deleted volume successfully. Apr 16 14:40:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-9cfe9572-501e-4c87-a299-f0de52d885a9 req-051286b0-01d5-4e8b-8fac-60375c29e955 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "cinder-6fc9a1f0-999c-4128-adf1-3ac62a1ae8ab-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "cinder-53433fe9-1cff-405e-a755-9db415d9b9f5-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-53433fe9-1cff-405e-a755-9db415d9b9f5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:11 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:UPDATE=178,cinder:SELECT=152,cinder:DELETE=14,cinder:INSERT=47 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:40:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "cinder-quobyte-53433fe9-1cff-405e-a755-9db415d9b9f5" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-quobyte-53433fe9-1cff-405e-a755-9db415d9b9f5" acquired by "delete_volume" :: waited 0.021s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:11 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb780cf-9730-457e-a965-12ad26ed085e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:11 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5 Apr 16 14:40:11 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:11 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5" returned: 0 in 0.521s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:11 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5 Apr 16 14:40:11 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=158,cinder:INSERT=48,cinder:UPDATE=205,cinder:DELETE=15 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Flow 'volume_create_manager' (3990e796-d9db-4592-acb5-c666748b83fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324ec087-8466-4849-bb55-1fc64852279d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324ec087-8466-4849-bb55-1fc64852279d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-949914189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fd7404-5606-4ec2-a664-f7724de6cc05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa0f548cb14a43c283e1ffb2a3466442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:12Z,use_quota=True,user_id='c1ecf022d20747e49ba0fd3edb52107f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6459227-b485-435f-a670-f955a335e9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6459227-b485-435f-a670-f955a335e9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2393c85-8fcf-4e9f-ae47-b09dad84c79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2393c85-8fcf-4e9f-ae47-b09dad84c79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1fd7404-5606-4ec2-a664-f7724de6cc05', 'volume_name': 'volume-c1fd7404-5606-4ec2-a664-f7724de6cc05', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3e8464-1990-444e-8560-4b0e026c3b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3e8464-1990-444e-8560-4b0e026c3b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702fc861-5d42-44e7-80e0-773aab2bed96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:12 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Volume c1fd7404-5606-4ec2-a664-f7724de6cc05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1fd7404-5606-4ec2-a664-f7724de6cc05', 'volume_size': 1} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-949914189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fd7404-5606-4ec2-a664-f7724de6cc05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa0f548cb14a43c283e1ffb2a3466442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:12Z,use_quota=True,user_id='c1ecf022d20747e49ba0fd3edb52107f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Creating volume c1fd7404-5606-4ec2-a664-f7724de6cc05 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:12 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:12 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05 1073741824 Apr 16 14:40:12 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Flow 'volume_create_manager' (9ac27993-7f76-4f49-930a-f8c04b173204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e642989-4792-4397-9e9a-07415d3d0a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e642989-4792-4397-9e9a-07415d3d0a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-901667764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3db298b-9215-4011-931e-77299db539d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ff679a84994a61aec4a7e52438ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:12Z,use_quota=True,user_id='dfc8533c841241c79fc44073354969c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49d32f23-82d3-4cd0-bc51-b5e270f0c6c8),volume_type_id=49d32f23-82d3-4cd0-bc51-b5e270f0c6c8)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d65f5e-1f5c-4182-bcaa-921b2f3baea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d65f5e-1f5c-4182-bcaa-921b2f3baea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2b8b82-9183-47f5-a970-be858fac0c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2b8b82-9183-47f5-a970-be858fac0c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3db298b-9215-4011-931e-77299db539d4', 'volume_name': 'volume-b3db298b-9215-4011-931e-77299db539d4', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47852b6c-1039-4f25-9b76-eac3f88cd160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47852b6c-1039-4f25-9b76-eac3f88cd160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d66341-a07b-44b1-b2ba-d1cd1bf165e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:12 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Volume b3db298b-9215-4011-931e-77299db539d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3db298b-9215-4011-931e-77299db539d4', 'volume_size': 1} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:12 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-53433fe9-1cff-405e-a755-9db415d9b9f5" returned: 0 in 0.741s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-quobyte-53433fe9-1cff-405e-a755-9db415d9b9f5" released by "delete_volume" :: held 1.291s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Created reservations ['1eea3791-931f-440c-b5e5-dc580fc9a6b6', '5ee4f86d-89ab-45d7-85a5-2572134b593e', 'fee5c80f-241a-4696-a19f-36b7748be7ef', 'a16d4607-de83-4498-9b59-b8d4060151b2'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:12 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:12 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:12 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05 1073741824" returned: 0 in 0.661s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:13 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05 Apr 16 14:40:13 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:13 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.458s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:13 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Deleted volume successfully. Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-40d5fe19-52da-4552-9017-34116d1a44ec tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-53433fe9-1cff-405e-a755-9db415d9b9f5-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:13 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05" returned: 0 in 0.429s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-901667764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3db298b-9215-4011-931e-77299db539d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ff679a84994a61aec4a7e52438ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:12Z,use_quota=True,user_id='dfc8533c841241c79fc44073354969c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49d32f23-82d3-4cd0-bc51-b5e270f0c6c8),volume_type_id=49d32f23-82d3-4cd0-bc51-b5e270f0c6c8)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Creating volume b3db298b-9215-4011-931e-77299db539d4 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:13 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702fc861-5d42-44e7-80e0-773aab2bed96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fd7404-5606-4ec2-a664-f7724de6cc05', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c8b27f-4de3-46f3-86c4-92f7b506a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:13 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4 1073741824 Apr 16 14:40:13 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:13 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Volume volume-c1fd7404-5606-4ec2-a664-f7724de6cc05 (c1fd7404-5606-4ec2-a664-f7724de6cc05): created successfully Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c8b27f-4de3-46f3-86c4-92f7b506a970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Flow 'volume_create_manager' (3990e796-d9db-4592-acb5-c666748b83fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:13 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-0bb93cb4-4e03-4bd9-908e-7e1c92621c6a tempest-AbsoluteLimitsTests-924341652 None] Created volume successfully. Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "cinder-4dd8e2e2-efbe-42a5-ba63-1448a7a33682-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-4dd8e2e2-efbe-42a5-ba63-1448a7a33682-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "cinder-quobyte-4dd8e2e2-efbe-42a5-ba63-1448a7a33682" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-quobyte-4dd8e2e2-efbe-42a5-ba63-1448a7a33682" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a85bc8-3d4f-40a3-89b9-d62a5bd32a20]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:13 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682 Apr 16 14:40:13 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:14 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4 1073741824" returned: 0 in 0.600s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:14 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4 Apr 16 14:40:14 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:14 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682" returned: 0 in 0.520s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:14 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682 Apr 16 14:40:14 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Acquiring lock "cinder-c1fd7404-5606-4ec2-a664-f7724de6cc05-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Lock "cinder-c1fd7404-5606-4ec2-a664-f7724de6cc05-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Acquiring lock "cinder-quobyte-c1fd7404-5606-4ec2-a664-f7724de6cc05" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Lock "cinder-quobyte-c1fd7404-5606-4ec2-a664-f7724de6cc05" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc9d55-61f6-474a-8ec3-7f49685eeb05]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:14 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05 Apr 16 14:40:14 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:14 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4" returned: 0 in 0.513s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d66341-a07b-44b1-b2ba-d1cd1bf165e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3db298b-9215-4011-931e-77299db539d4', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:14 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4619de2-6e5e-4630-bab0-9362d0092456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4dd8e2e2-efbe-42a5-ba63-1448a7a33682" returned: 0 in 0.468s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:14 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Volume volume-b3db298b-9215-4011-931e-77299db539d4 (b3db298b-9215-4011-931e-77299db539d4): created successfully Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4619de2-6e5e-4630-bab0-9362d0092456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Flow 'volume_create_manager' (9ac27993-7f76-4f49-930a-f8c04b173204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-quobyte-4dd8e2e2-efbe-42a5-ba63-1448a7a33682" released by "delete_volume" :: held 1.021s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:14 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-fdfb4657-a405-432e-9053-98b2d134454b tempest-VolumeTypesAccessTest-776863099 None] Created volume successfully. Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Created reservations ['9c1efe22-d404-4af2-a95b-c646a5dbd07d', '987ad139-c31e-41da-8013-24460b6f9529', 'ed21d65c-2c7e-420a-8c36-71ab6c65ffac', '70af1bfa-35f6-4f85-b921-73059e79c17c'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:14 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:14 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:14 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05" returned: 0 in 0.492s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:14 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05 Apr 16 14:40:14 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:15 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.421s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:15 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Deleted volume successfully. Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cec91d31-115f-4fc4-9946-d7fd28fe6c7b tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-4dd8e2e2-efbe-42a5-ba63-1448a7a33682-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:15 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c1fd7404-5606-4ec2-a664-f7724de6cc05" returned: 0 in 0.433s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Lock "cinder-quobyte-c1fd7404-5606-4ec2-a664-f7724de6cc05" released by "delete_volume" :: held 0.949s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Created reservations ['beddd3f3-827c-4f97-9460-1424abf0efd6', '9558c391-6493-4318-b502-d258af0b8dd0', '35da1867-09c1-4718-802e-b26401326012', '49229d6d-2ea2-43b7-8665-22f5e0ac8268'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:15 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:15 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Acquiring lock "cinder-b3db298b-9215-4011-931e-77299db539d4-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Lock "cinder-b3db298b-9215-4011-931e-77299db539d4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Acquiring lock "cinder-quobyte-b3db298b-9215-4011-931e-77299db539d4" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Lock "cinder-quobyte-b3db298b-9215-4011-931e-77299db539d4" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bb9e35-63e0-4b04-bc71-4ff90cc81665]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:15 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4 Apr 16 14:40:15 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "cinder-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "cinder-quobyte-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-quobyte-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[615e068b-931a-4adb-8044-c722683ffbda]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:15 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f Apr 16 14:40:15 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:15 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.441s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:15 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Deleted volume successfully. Apr 16 14:40:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dd24ade2-b8fe-4fe7-a1cd-a5e6ca4d0ea5 tempest-AbsoluteLimitsTests-924341652 None] Lock "cinder-c1fd7404-5606-4ec2-a664-f7724de6cc05-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:16 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4" returned: 0 in 0.567s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:16 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4 Apr 16 14:40:16 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:16 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f" returned: 0 in 0.468s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:16 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f Apr 16 14:40:16 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:16 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b3db298b-9215-4011-931e-77299db539d4" returned: 0 in 0.438s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Lock "cinder-quobyte-b3db298b-9215-4011-931e-77299db539d4" released by "delete_volume" :: held 1.046s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:16 devstack cinder-volume[83305]: WARNING cinder.quota [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-231420005 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-231420005, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:40:16 devstack cinder-volume[83305]: WARNING cinder.quota [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-231420005 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-231420005, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Created reservations ['8382ed31-0fab-47fb-bc89-28f757cb2840', '9d05167f-c793-4b22-ab3a-cb60155c993a', '67500e88-aa57-4292-99f8-fd4b5c0df864', '32cc0653-0109-4f7f-aca9-931cb6f26d5d'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:16 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f" returned: 0 in 0.444s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-quobyte-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f" released by "delete_volume" :: held 0.943s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Created reservations ['048ba6ad-d06a-4f74-916b-b2ecb9279292', '22e3474a-bb7d-4f41-8628-0b39229d7fc9', '23ff0924-0812-46c8-988b-939ca85de02b', 'f0b8c402-e8f3-4a20-9537-8fddc2113ae0'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:16 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:16 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:16 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:16 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:17 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.527s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:17 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:17 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Deleted volume successfully. Apr 16 14:40:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-dcd36a96-29b0-4e62-bb89-fe3c055b7728 tempest-VolumeTypesAccessTest-776863099 None] Lock "cinder-b3db298b-9215-4011-931e-77299db539d4-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:17 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.489s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:17 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:17 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Deleted volume successfully. Apr 16 14:40:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cfd07468-c90d-4e55-bff6-823510c6dd6f tempest-VolumesListTestJSON-2086992845 None] Lock "cinder-f42f1aa6-6b2e-4713-b0d3-2b68efa3eb2f-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Flow 'volume_create_manager' (b87ecafe-efa0-4283-a598-33329351b240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82fc9be-084c-43c9-9502-963afbd1d6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82fc9be-084c-43c9-9502-963afbd1d6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-945058660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35793b49-15db-45a0-9925-1a069522035f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e31fd78f0464da69a0be9d816ba567b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:20Z,use_quota=True,user_id='61579ca119f0400fbcd7ca1840be9eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a486b7f-8531-4664-960b-3581845779ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a486b7f-8531-4664-960b-3581845779ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c52e34b-0a80-4f6c-94c9-a941793546cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c52e34b-0a80-4f6c-94c9-a941793546cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35793b49-15db-45a0-9925-1a069522035f', 'volume_name': 'volume-35793b49-15db-45a0-9925-1a069522035f', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c1139d-9085-46c8-ba5c-0b2a6c1ef581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c1139d-9085-46c8-ba5c-0b2a6c1ef581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb60422-e407-4054-8b0c-2e5961c4f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:19 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Volume 35793b49-15db-45a0-9925-1a069522035f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35793b49-15db-45a0-9925-1a069522035f', 'volume_size': 1} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-945058660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35793b49-15db-45a0-9925-1a069522035f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e31fd78f0464da69a0be9d816ba567b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:20Z,use_quota=True,user_id='61579ca119f0400fbcd7ca1840be9eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Creating volume 35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:19 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:20 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f 1073741824 Apr 16 14:40:20 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:20 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f 1073741824" returned: 0 in 0.570s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:20 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f Apr 16 14:40:20 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:21 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f" returned: 0 in 0.492s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb60422-e407-4054-8b0c-2e5961c4f602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35793b49-15db-45a0-9925-1a069522035f', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb52e247-747f-48bb-9f5e-e7ce2ad4a6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:21 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Volume volume-35793b49-15db-45a0-9925-1a069522035f (35793b49-15db-45a0-9925-1a069522035f): created successfully Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb52e247-747f-48bb-9f5e-e7ce2ad4a6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Flow 'volume_create_manager' (b87ecafe-efa0-4283-a598-33329351b240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:21 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-27a1661c-94d3-464d-b295-364ce839567b tempest-VolumesSnapshotListTestJSON-1995960431 None] Created volume successfully. Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Flow 'volume_create_manager' (bddbd4ee-9e31-4fc8-99b6-6530bbdcf259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dc695d-1993-4a44-85ef-88ef28515195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dc695d-1993-4a44-85ef-88ef28515195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-204456397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1fa7a40-1a5f-4366-903d-57ad6c27cd65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40ff232834df47f1a1541b07571a1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:21Z,use_quota=True,user_id='64098cb66a6d43b89c8c42a7d4c494bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f875b023-d78b-4716-80ff-499356c4d8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f875b023-d78b-4716-80ff-499356c4d8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e87d73-8b57-4294-b1e0-c06b1771a897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e87d73-8b57-4294-b1e0-c06b1771a897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1fa7a40-1a5f-4366-903d-57ad6c27cd65', 'volume_name': 'volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a55ea8-6b02-4f41-a000-19799506ceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a55ea8-6b02-4f41-a000-19799506ceb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48e1bc4-2a33-4413-aaae-b3fb97c9af48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:21 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Volume a1fa7a40-1a5f-4366-903d-57ad6c27cd65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65', 'volume_size': 1} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-204456397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1fa7a40-1a5f-4366-903d-57ad6c27cd65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40ff232834df47f1a1541b07571a1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:21Z,use_quota=True,user_id='64098cb66a6d43b89c8c42a7d4c494bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Creating volume a1fa7a40-1a5f-4366-903d-57ad6c27cd65 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:21 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:21 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65 1073741824 Apr 16 14:40:21 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:21 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-662d312f-af8e-4fd3-b83d-f6392847915e req-67a29f55-d860-4995-b8d5-c8bc33e1aec7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Terminate volume connection completed successfully. Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-662d312f-af8e-4fd3-b83d-f6392847915e req-67a29f55-d860-4995-b8d5-c8bc33e1aec7 tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Deleting attachment b1a370e7-66f3-4b66-ae1c-345cc1863ff0. {{(pid=83305) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 14:40:21 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65 1073741824" returned: 0 in 0.573s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:21 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65 Apr 16 14:40:21 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "cinder-ede69f1e-bd94-4169-aaaf-9171eed7b7b6-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "cinder-ede69f1e-bd94-4169-aaaf-9171eed7b7b6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "cinder-quobyte-ede69f1e-bd94-4169-aaaf-9171eed7b7b6" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "cinder-quobyte-ede69f1e-bd94-4169-aaaf-9171eed7b7b6" acquired by "delete_volume" :: waited 0.016s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aae782-a393-4af3-baa9-a0f060f88709]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:22 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 Apr 16 14:40:22 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:22 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65" returned: 0 in 0.577s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.334s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] Creating offline snapshot 62532c94-b89b-4d62-9548-d126e11af8cf of volume 35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48e1bc4-2a33-4413-aaae-b3fb97c9af48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be40604-30d9-4152-a3db-9356073ceef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12e8521-dd85-482d-a5d6-69db396f58aa]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:22 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Volume volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65 (a1fa7a40-1a5f-4366-903d-57ad6c27cd65): created successfully Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be40604-30d9-4152-a3db-9356073ceef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Flow 'volume_create_manager' (bddbd4ee-9e31-4fc8-99b6-6530bbdcf259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:22 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a72fdc37-8526-46fa-8a5a-41da9d4209da tempest-VolumesTransfersTest-1371443343 None] Created volume successfully. Apr 16 14:40:22 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f Apr 16 14:40:22 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:22 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6" returned: 0 in 0.610s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:22 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6 Apr 16 14:40:22 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:23 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f" returned: 0 in 0.622s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:23 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf 1G Apr 16 14:40:23 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:23 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ede69f1e-bd94-4169-aaaf-9171eed7b7b6" returned: 0 in 0.615s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "cinder-quobyte-ede69f1e-bd94-4169-aaaf-9171eed7b7b6" released by "delete_volume" :: held 1.260s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG cinder.quota [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Created reservations ['c3ef78cd-f543-41fe-a6f5-a8053091853a', '853ac5c1-5622-47dd-a490-dcde05508789', '275f498a-a10a-4b27-aef3-55da5d36273c', 'bab04fa7-f305-4514-a90e-8e84f05081ea'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:23 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:23 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:23 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:23 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a328ff80-14dc-4044-b402-5b0fb466935e tempest-VolumesTransfersTest-1898931492 None] Transfer volume completed successfully. Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf 1G" returned: 0 in 0.716s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35793b49-15db-45a0-9925-1a069522035f -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:23 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35793b49-15db-45a0-9925-1a069522035f -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf Apr 16 14:40:23 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:23 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.581s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:23 devstack cinder-volume[83305]: DEBUG cinder.manager [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:24 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Deleted volume successfully. Apr 16 14:40:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-662d312f-af8e-4fd3-b83d-f6392847915e req-2dcc09c8-4a21-4287-9eba-b3e7da77bd3d tempest-ServerBootFromVolumeStableRescueTest-111702014 None] Lock "cinder-ede69f1e-bd94-4169-aaaf-9171eed7b7b6-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:24 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35793b49-15db-45a0-9925-1a069522035f -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf" returned: 0 in 0.543s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:24 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf is being set with open permissions: ugo+rw Apr 16 14:40:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:24 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf Apr 16 14:40:24 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Acquiring lock "cinder-a1fa7a40-1a5f-4366-903d-57ad6c27cd65-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Lock "cinder-a1fa7a40-1a5f-4366-903d-57ad6c27cd65-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Acquiring lock "cinder-quobyte-a1fa7a40-1a5f-4366-903d-57ad6c27cd65" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Lock "cinder-quobyte-a1fa7a40-1a5f-4366-903d-57ad6c27cd65" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:24 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86245476-648b-411c-bb7e-38bbcef2196c]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:24 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65 Apr 16 14:40:24 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:24 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf" returned: 0 in 0.526s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:24 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.info Apr 16 14:40:24 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:25 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65" returned: 0 in 0.590s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:25 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65 Apr 16 14:40:25 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:25 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.info" returned: 0 in 0.547s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:25 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.info is being set with open permissions: ugo+rw Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:25 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.info Apr 16 14:40:25 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:25 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1fa7a40-1a5f-4366-903d-57ad6c27cd65" returned: 0 in 0.458s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Lock "cinder-quobyte-a1fa7a40-1a5f-4366-903d-57ad6c27cd65" released by "delete_volume" :: held 1.074s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Created reservations ['c86ae010-b832-4f5c-87ff-78f41624cd13', 'd5499bd3-9965-4749-9549-43cb944e582b', '1451f2d9-07f0-4868-ae27-7dddac6131fd', '60ed73b3-878d-4648-9e95-b496de91c556'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:25 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:25 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:26 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.info" returned: 0 in 0.537s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.582s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:26 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b1eb5d5c-5fcc-484a-a7e4-0c001e6a1233 tempest-VolumesSnapshotListTestJSON-1995960431 None] Create snapshot completed successfully Apr 16 14:40:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] Creating offline snapshot b1c7448a-8df1-4161-bdd0-578c86bccf94 of volume 35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:40:26 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6ca2af-cb8c-44cb-b54e-f7a9634ea5df]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:26 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.546s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:26 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:26 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Deleted volume successfully. Apr 16 14:40:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-74bb8ffd-b71e-4d49-ab2f-041bc5a0e7b8 tempest-VolumesTransfersTest-1637744681 None] Lock "cinder-a1fa7a40-1a5f-4366-903d-57ad6c27cd65-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:26 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf Apr 16 14:40:26 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:27 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf" returned: 0 in 0.661s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35793b49-15db-45a0-9925-1a069522035f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:27 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 1G Apr 16 14:40:27 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Flow 'volume_create_manager' (03ab4d59-c912-42d2-9db1-38235ad7b1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2f5e0b-860e-4ea6-b5dc-bce37868b6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2f5e0b-860e-4ea6-b5dc-bce37868b6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1430761136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc1f5f8-62ac-4f30-929e-63002d43e822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40ff232834df47f1a1541b07571a1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:27Z,use_quota=True,user_id='64098cb66a6d43b89c8c42a7d4c494bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52141ae-e93c-49d6-b5bd-609fc6a2fd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52141ae-e93c-49d6-b5bd-609fc6a2fd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8fb5dd-504d-4594-a4aa-c296f767e673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8fb5dd-504d-4594-a4aa-c296f767e673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc1f5f8-62ac-4f30-929e-63002d43e822', 'volume_name': 'volume-7bc1f5f8-62ac-4f30-929e-63002d43e822', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e444dd5c-2352-4f72-a59a-a8525b2b1e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e444dd5c-2352-4f72-a59a-a8525b2b1e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8f56f7-eba4-4ba2-89b8-3a9d00882acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:27 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Volume 7bc1f5f8-62ac-4f30-929e-63002d43e822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc1f5f8-62ac-4f30-929e-63002d43e822', 'volume_size': 1} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:27 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 1G" returned: 0 in 0.645s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:27 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 Apr 16 14:40:27 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:28 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94" returned: 0 in 0.543s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:28 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 is being set with open permissions: ugo+rw Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:28 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 Apr 16 14:40:28 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:28 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94" returned: 0 in 0.460s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.429s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1430761136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc1f5f8-62ac-4f30-929e-63002d43e822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40ff232834df47f1a1541b07571a1132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:27Z,use_quota=True,user_id='64098cb66a6d43b89c8c42a7d4c494bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Creating volume 7bc1f5f8-62ac-4f30-929e-63002d43e822 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:28 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:28 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822 1073741824 Apr 16 14:40:28 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:28 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-239566a8-346b-4947-814f-4097440e1bda tempest-VolumesSnapshotListTestJSON-1995960431 None] Create snapshot completed successfully Apr 16 14:40:29 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822 1073741824" returned: 0 in 0.624s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:29 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822 Apr 16 14:40:29 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:29 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822" returned: 0 in 0.457s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.235s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8f56f7-eba4-4ba2-89b8-3a9d00882acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc1f5f8-62ac-4f30-929e-63002d43e822', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa17834-a04d-44ea-92c4-9dea093cd893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] Creating offline snapshot e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 of volume 35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:40:29 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Volume volume-7bc1f5f8-62ac-4f30-929e-63002d43e822 (7bc1f5f8-62ac-4f30-929e-63002d43e822): created successfully Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa17834-a04d-44ea-92c4-9dea093cd893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Flow 'volume_create_manager' (03ab4d59-c912-42d2-9db1-38235ad7b1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9d4e41-de51-4f75-af95-149a841e927b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:29 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-76c26d8d-237a-4529-8568-1906f067781b tempest-VolumesTransfersTest-1371443343 None] Created volume successfully. Apr 16 14:40:30 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 Apr 16 14:40:30 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:30 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94" returned: 0 in 0.598s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35793b49-15db-45a0-9925-1a069522035f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:40:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:30 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 1G Apr 16 14:40:30 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:30 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Acquiring lock "cinder-7bc1f5f8-62ac-4f30-929e-63002d43e822-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:30 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Lock "cinder-7bc1f5f8-62ac-4f30-929e-63002d43e822-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:30 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Acquiring lock "cinder-quobyte-7bc1f5f8-62ac-4f30-929e-63002d43e822" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:30 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Lock "cinder-quobyte-7bc1f5f8-62ac-4f30-929e-63002d43e822" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:30 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e11b8b2-fb61-43a0-981d-4f51080fae00]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:30 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822 Apr 16 14:40:30 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:31 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 1G" returned: 0 in 0.638s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:31 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 Apr 16 14:40:31 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:31 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822" returned: 0 in 0.685s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:31 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822 Apr 16 14:40:31 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:31 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5" returned: 0 in 0.573s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:31 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 is being set with open permissions: ugo+rw Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:31 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 Apr 16 14:40:31 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:31 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7bc1f5f8-62ac-4f30-929e-63002d43e822" returned: 0 in 0.464s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Lock "cinder-quobyte-7bc1f5f8-62ac-4f30-929e-63002d43e822" released by "delete_volume" :: held 1.175s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Created reservations ['99ab665c-ff94-42d4-bd1b-2e7f5cae8dd9', '9e18c28d-cf52-4c0c-9e7f-6b7df9dcb5c2', '2762edd0-81d7-48fe-af9b-c4d2ba2443f2', '0e686392-0d82-4782-a1f2-75134b96f1aa'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:32 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:32 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:32 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5" returned: 0 in 0.467s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:32 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-80f4bcd2-1089-46b6-9ed4-7146770b3990 tempest-VolumesSnapshotListTestJSON-1995960431 None] Create snapshot completed successfully Apr 16 14:40:32 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.543s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:32 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:32 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Deleted volume successfully. Apr 16 14:40:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b0ad5024-b77e-474b-8de9-b5e63256086d tempest-VolumesTransfersTest-1637744681 None] Lock "cinder-7bc1f5f8-62ac-4f30-929e-63002d43e822-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "cinder-e49a7c3e-6bce-473d-83a9-b4923a9a4cb5-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-e49a7c3e-6bce-473d-83a9-b4923a9a4cb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "cinder-quobyte-e49a7c3e-6bce-473d-83a9-b4923a9a4cb5" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-e49a7c3e-6bce-473d-83a9-b4923a9a4cb5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Deleting offline snapshot e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 of volume 35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:40:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] snapshot_file for this snap is: volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:40:33 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7ffb93-57c2-48b2-8a8a-7cf9d1400922]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:33 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 Apr 16 14:40:33 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:34 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5" returned: 0 in 0.581s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35793b49-15db-45a0-9925-1a069522035f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:40:34 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f215bd0-230e-4a9b-acdb-3d2492f8758d]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:34 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 Apr 16 14:40:34 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:34 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94" returned: 0 in 0.552s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35793b49-15db-45a0-9925-1a069522035f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:40:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:34 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 Apr 16 14:40:34 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:35 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5" returned: 0 in 0.487s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:35 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5 Apr 16 14:40:35 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:35 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.e49a7c3e-6bce-473d-83a9-b4923a9a4cb5" returned: 0 in 0.444s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:35 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-e49a7c3e-6bce-473d-83a9-b4923a9a4cb5" released by "_delete_snapshot" :: held 2.124s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:35 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" released by "delete_snapshot" :: held 2.143s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:35 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Created reservations ['c3ca358b-26c7-4a66-ad64-eee6aa63e77f', '3e72b031-906f-40cf-9b1b-69944963acec', 'abde53e1-a297-461b-b12f-4b79a8a953db', 'd8a313f5-c59e-443a-8106-b7a6829c1cc0'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:35 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Delete snapshot completed successfully. Apr 16 14:40:35 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c515790b-44c9-49cb-8d0f-5f4ca45ca76d tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-e49a7c3e-6bce-473d-83a9-b4923a9a4cb5-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "cinder-b1c7448a-8df1-4161-bdd0-578c86bccf94-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-b1c7448a-8df1-4161-bdd0-578c86bccf94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "cinder-quobyte-b1c7448a-8df1-4161-bdd0-578c86bccf94" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-b1c7448a-8df1-4161-bdd0-578c86bccf94" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Deleting offline snapshot b1c7448a-8df1-4161-bdd0-578c86bccf94 of volume 35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:40:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] snapshot_file for this snap is: volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:40:36 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[176f2580-3333-40e8-ade5-d840034b015c]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:36 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 Apr 16 14:40:36 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:37 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94" returned: 0 in 0.664s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35793b49-15db-45a0-9925-1a069522035f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:40:37 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aa6f1d-fd90-4412-b4b0-fc9dc8d0b77a]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:37 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf Apr 16 14:40:37 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:38 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf" returned: 0 in 0.662s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35793b49-15db-45a0-9925-1a069522035f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:40:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:38 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 Apr 16 14:40:38 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:38 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94" returned: 0 in 0.572s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:38 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94 Apr 16 14:40:38 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:39 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.b1c7448a-8df1-4161-bdd0-578c86bccf94" returned: 0 in 0.535s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-b1c7448a-8df1-4161-bdd0-578c86bccf94" released by "_delete_snapshot" :: held 2.504s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" released by "delete_snapshot" :: held 2.516s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Created reservations ['f8ede4f0-bdfe-442a-931d-be993d4dfc1c', '18718adf-2004-4915-bcc6-f6ef3ddf4c0e', 'a4d9453d-14f7-4d7a-af2d-fc61a5a3d051', 'ca02f403-4835-4abb-a7a3-b05e7470f01e'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:39 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Delete snapshot completed successfully. Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c97d68c-e412-40c7-806d-c20494349ded tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-b1c7448a-8df1-4161-bdd0-578c86bccf94-delete_snapshot" released by "delete_snapshot" :: held 2.618s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "cinder-62532c94-b89b-4d62-9548-d126e11af8cf-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-62532c94-b89b-4d62-9548-d126e11af8cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "cinder-quobyte-62532c94-b89b-4d62-9548-d126e11af8cf" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-62532c94-b89b-4d62-9548-d126e11af8cf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Deleting offline snapshot 62532c94-b89b-4d62-9548-d126e11af8cf of volume 35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] snapshot_file for this snap is: volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05d2303-e244-4c54-b1b5-8a31178c70b7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:40 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf Apr 16 14:40:40 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:40 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf" returned: 0 in 0.654s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35793b49-15db-45a0-9925-1a069522035f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:40:40 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[90251fb0-ba1b-427e-9af8-eb370aa54c87]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:40 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f Apr 16 14:40:40 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Flow 'volume_create_manager' (bd981c04-d6ce-493f-810a-5eda362ae242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239108cc-40ed-4933-be4d-aa35ca4118dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239108cc-40ed-4933-be4d-aa35ca4118dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1392973202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c82336-3465-4f59-a9e1-77b8d9a01466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8021f620d4629918a53c2004b3f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:41Z,use_quota=True,user_id='cbf156a52cca496c98990261e47ff002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901abcd1-1201-4e92-a6cd-c4f9bcca1bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901abcd1-1201-4e92-a6cd-c4f9bcca1bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc540b55-2adf-4cac-b394-ed712e032ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.image.glance [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Creating Keystone auth plugin from conf {{(pid=83305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 14:40:41 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f" returned: 0 in 0.602s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:41 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf Apr 16 14:40:41 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc540b55-2adf-4cac-b394-ed712e032ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2c82336-3465-4f59-a9e1-77b8d9a01466', 'volume_name': 'volume-f2c82336-3465-4f59-a9e1-77b8d9a01466', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a99f41-2210-454e-85a8-0a2792a0179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a99f41-2210-454e-85a8-0a2792a0179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9054e3-2f6a-4af2-abbd-e042e5f1e427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:41 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Volume f2c82336-3465-4f59-a9e1-77b8d9a01466: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2c82336-3465-4f59-a9e1-77b8d9a01466', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Trying to clone f2c82336-3465-4f59-a9e1-77b8d9a01466 from image a03b4007-0186-44e1-a560-91d8e58559a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]). {{(pid=83305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Flow 'volume_create_manager' (612a2b5c-0364-4a3e-87ec-c08b4d30c3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf21510-8a9d-4063-8673-98ab68e8a867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf21510-8a9d-4063-8673-98ab68e8a867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-75022389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3988fdf9-350c-4164-ba7f-035de2a304cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1b589130f614f029d891009730d872a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:42Z,use_quota=True,user_id='2faa37ddb0304ecea3d669d1d8915fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad513d0-f380-4d97-86e0-77755934a9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad513d0-f380-4d97-86e0-77755934a9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a82e4ec-5931-43d4-9afa-935b4b492c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a82e4ec-5931-43d4-9afa-935b4b492c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3988fdf9-350c-4164-ba7f-035de2a304cf', 'volume_name': 'volume-3988fdf9-350c-4164-ba7f-035de2a304cf', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea26231-3652-435b-805d-e06a8c9ba983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea26231-3652-435b-805d-e06a8c9ba983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c73be7-1fec-4c13-bbd2-7a96a194f5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:41 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Volume 3988fdf9-350c-4164-ba7f-035de2a304cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3988fdf9-350c-4164-ba7f-035de2a304cf', 'volume_size': 1} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-75022389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3988fdf9-350c-4164-ba7f-035de2a304cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1b589130f614f029d891009730d872a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:42Z,use_quota=True,user_id='2faa37ddb0304ecea3d669d1d8915fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Creating volume 3988fdf9-350c-4164-ba7f-035de2a304cf {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:41 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 14:40:41 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Image download 20.69 MB at 20.69 MB/s Apr 16 14:40:41 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf 1073741824 Apr 16 14:40:41 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a4e3b1-8e16-4e63-85c7-0f9bb37ca4b7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:42 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD Apr 16 14:40:42 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:42 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf" returned: 0 in 0.820s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:42 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf Apr 16 14:40:42 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:42 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf 1073741824" returned: 0 in 0.764s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:42 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf Apr 16 14:40:42 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:42 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Temporary image a03b4007-0186-44e1-a560-91d8e58559a1 is fetched for user cbf156a52cca496c98990261e47ff002. {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 14:40:42 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f.62532c94-b89b-4d62-9548-d126e11af8cf" returned: 0 in 0.639s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-62532c94-b89b-4d62-9548-d126e11af8cf" released by "_delete_snapshot" :: held 2.808s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c012b382-ac23-4fa6-9c15-8238ad136284]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" released by "delete_snapshot" :: held 2.854s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Created reservations ['85e659db-40c4-473f-8a9a-d2895ac98580', '211044c0-78d5-4018-9479-5f54cec93857', '2a4d5717-4a0e-4094-a4d8-9b2e9bbd30d3', '6a2aff09-38af-4533-a734-3715a62d7cc7'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:42 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD Apr 16 14:40:42 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:42 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Delete snapshot completed successfully. Apr 16 14:40:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fee555db-deb3-47e3-bcb7-7936005fb201 tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-62532c94-b89b-4d62-9548-d126e11af8cf-delete_snapshot" released by "delete_snapshot" :: held 2.987s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "cinder-35793b49-15db-45a0-9925-1a069522035f-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-35793b49-15db-45a0-9925-1a069522035f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:43 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf" returned: 0 in 0.515s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c73be7-1fec-4c13-bbd2-7a96a194f5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3988fdf9-350c-4164-ba7f-035de2a304cf', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ade486-a3a1-44e2-ac58-31f9409c78d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:43 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Volume volume-3988fdf9-350c-4164-ba7f-035de2a304cf (3988fdf9-350c-4164-ba7f-035de2a304cf): created successfully Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ade486-a3a1-44e2-ac58-31f9409c78d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Flow 'volume_create_manager' (612a2b5c-0364-4a3e-87ec-c08b4d30c3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:43 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-000be14a-594c-4f2e-bef2-8babb5025e4c req-2c5dfa13-cd1f-4631-9db0-c4f882f5f82e tempest-VolumesGetTestJSON-621308111 None] Created volume successfully. Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c436570-3e27-4ed3-a095-ac190648bf10]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:43 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:43 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:43 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1392973202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c82336-3465-4f59-a9e1-77b8d9a01466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8021f620d4629918a53c2004b3f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:41Z,use_quota=True,user_id='cbf156a52cca496c98990261e47ff002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Creating volume f2c82336-3465-4f59-a9e1-77b8d9a01466 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:43 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:43 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 1073741824 Apr 16 14:40:43 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:43 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f" returned: 0 in 0.603s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:43 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f Apr 16 14:40:43 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:43 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 1073741824" returned: 0 in 0.595s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:43 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 Apr 16 14:40:43 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Acquiring lock "cinder-3988fdf9-350c-4164-ba7f-035de2a304cf-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Lock "cinder-3988fdf9-350c-4164-ba7f-035de2a304cf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Acquiring lock "cinder-quobyte-3988fdf9-350c-4164-ba7f-035de2a304cf" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Lock "cinder-quobyte-3988fdf9-350c-4164-ba7f-035de2a304cf" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9075d66-1aa2-4034-b06d-6622edc8220e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:44 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf Apr 16 14:40:44 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:44 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466" returned: 0 in 0.535s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:44 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Attempting download of a03b4007-0186-44e1-a560-91d8e58559a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}])) to volume f2c82336-3465-4f59-a9e1-77b8d9a01466. {{(pid=83305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-35793b49-15db-45a0-9925-1a069522035f" returned: 0 in 0.654s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-quobyte-35793b49-15db-45a0-9925-1a069522035f" released by "delete_volume" :: held 1.292s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[27716a07-2c82-4828-85f5-7dfc2e8be498]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Created reservations ['dde4ff9d-3eeb-4e57-a659-ea65de240e6e', 'ac8d57e3-ef9a-4eb2-8a88-6acd23bb80c0', '0cb6b50f-16ca-4394-ae3c-b3a1c0517a22', '7dca2834-815b-43e4-8415-ddc52ca22c26'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_zh7o4u17 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:44 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_zh7o4u17 Apr 16 14:40:44 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:44 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:44 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:44 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf" returned: 0 in 0.660s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:44 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf Apr 16 14:40:44 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:45 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_zh7o4u17" returned: 0 in 0.627s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_zh7o4u17 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:45 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-3988fdf9-350c-4164-ba7f-035de2a304cf" returned: 0 in 0.493s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:45 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Lock "cinder-quobyte-3988fdf9-350c-4164-ba7f-035de2a304cf" released by "delete_volume" :: held 1.180s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:45 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_zh7o4u17 Apr 16 14:40:45 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.583s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:45 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Deleted volume successfully. Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4ae786e0-23a6-487b-9f44-42e734e2ddcb tempest-VolumesSnapshotListTestJSON-1995960431 None] Lock "cinder-35793b49-15db-45a0-9925-1a069522035f-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG cinder.quota [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Created reservations ['43a12942-503a-4763-84ed-5d917f7fd051', '06e6e816-c167-4dc7-8c58-da97d1b73bc8', '04d0eff2-80f8-43cd-aeba-2008fec521d4', 'bbc51fdc-8576-4e8e-b46c-1d817fbd57f0'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:45 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:45 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:46 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_zh7o4u17" returned: 1 in 0.865s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_zh7o4u17' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d94a60-b265-40b3-9d85-214af47e3193]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:46 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.738s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG cinder.manager [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:46 devstack cinder-volume[83305]: INFO cinder.volume.manager [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Deleted volume successfully. Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [req-a9e00891-317a-4491-ba87-934303f512d4 req-0db35544-0c38-49aa-be1a-e969e27094ea tempest-VolumesGetTestJSON-621308111 None] Lock "cinder-3988fdf9-350c-4164-ba7f-035de2a304cf-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:46 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD Apr 16 14:40:46 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo_service.periodic_task [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:46 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:46 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:46 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] a03b4007-0186-44e1-a560-91d8e58559a1 was qcow2, converting to raw {{(pid=83305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 14:40:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:46 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 Apr 16 14:40:46 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:47 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.836s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:47 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:48 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466" returned: 0 in 1.256s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_9o46lq6jdevstack@QuobyteHD, size 112.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:40:48 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Converted 112.00 MB image at 89.03 MB/s Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:48 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 1G Apr 16 14:40:48 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Flow 'volume_create_manager' (54b8e8b3-4c82-4a86-991d-4ce5001bdb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e355e435-91c9-4639-b2ff-807495e96c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e355e435-91c9-4639-b2ff-807495e96c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-761599149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b342ac3-f99b-4d19-bff9-10bd62b68d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5d3612691a4e308333ea2425a2e895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:48Z,use_quota=True,user_id='5b05ff41849e473fb471ffccc3396d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ffc17f-606d-4414-8fdc-2cae44cc9a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ffc17f-606d-4414-8fdc-2cae44cc9a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b37722-b466-4003-862f-578f7799deda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b37722-b466-4003-862f-578f7799deda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b342ac3-f99b-4d19-bff9-10bd62b68d15', 'volume_name': 'volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15', 'volume_size': 2}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ef4002-2e3c-4522-bfd2-6a62e244d7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ef4002-2e3c-4522-bfd2-6a62e244d7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3a5ec5-5459-4064-994e-70997e86b2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:48 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Volume 7b342ac3-f99b-4d19-bff9-10bd62b68d15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15', 'volume_size': 2} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-761599149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b342ac3-f99b-4d19-bff9-10bd62b68d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5d3612691a4e308333ea2425a2e895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:48Z,use_quota=True,user_id='5b05ff41849e473fb471ffccc3396d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Creating volume 7b342ac3-f99b-4d19-bff9-10bd62b68d15 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:48 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 2147483648 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:48 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 2147483648 Apr 16 14:40:48 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Flow 'volume_create_manager' (ac88d7f1-263d-4bfb-b900-55812a1dd186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e76dba0-e0f0-4827-b1df-83946e9e7ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:48 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e76dba0-e0f0-4827-b1df-83946e9e7ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-170656028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d877bb99322348bea2c69477a5c75d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:49Z,use_quota=True,user_id='4eeef4ab2b4a4da6a771344321f3b973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a1a96c-5bdf-455e-bad7-4428a0b26513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a1a96c-5bdf-455e-bad7-4428a0b26513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cb6f4c-c99a-4054-9504-0077f10dc292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cb6f4c-c99a-4054-9504-0077f10dc292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a', 'volume_name': 'volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458005d3-61c9-45ae-8fb2-37dd5a6abf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458005d3-61c9-45ae-8fb2-37dd5a6abf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89da166-c4a7-44e4-a592-98e397a0bb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:48 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Volume c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a', 'volume_size': 1} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 1G" returned: 0 in 0.602s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[659d946e-f801-4f09-9393-9eb6a31b9bc6]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:48 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 Apr 16 14:40:48 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:49 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 2147483648" returned: 0 in 0.575s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:49 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 Apr 16 14:40:49 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:49 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466" returned: 0 in 0.524s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:49 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 Apr 16 14:40:49 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:49 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15" returned: 0 in 0.461s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.935s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-170656028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d877bb99322348bea2c69477a5c75d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:49Z,use_quota=True,user_id='4eeef4ab2b4a4da6a771344321f3b973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Creating volume c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:49 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3a5ec5-5459-4064-994e-70997e86b2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15', 'volume_size': 2}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:49 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a 1073741824 Apr 16 14:40:49 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f663e167-8d1d-4369-8efe-c781b634f078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:49 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Volume volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 (7b342ac3-f99b-4d19-bff9-10bd62b68d15): created successfully Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f663e167-8d1d-4369-8efe-c781b634f078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Flow 'volume_create_manager' (54b8e8b3-4c82-4a86-991d-4ce5001bdb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:49 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-42227d6b-bf80-41d7-bd03-4e3e5aac91ab tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Created volume successfully. Apr 16 14:40:49 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466" returned: 1 in 0.508s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Downloaded image a03b4007-0186-44e1-a560-91d8e58559a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}])) to volume f2c82336-3465-4f59-a9e1-77b8d9a01466 successfully. {{(pid=83305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Temporary image a03b4007-0186-44e1-a560-91d8e58559a1 for user cbf156a52cca496c98990261e47ff002 is deleted. {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Marking volume f2c82336-3465-4f59-a9e1-77b8d9a01466 as bootable. {{(pid=83305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Copying metadata from image a03b4007-0186-44e1-a560-91d8e58559a1 to f2c82336-3465-4f59-a9e1-77b8d9a01466. {{(pid=83305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Creating volume glance metadata for volume f2c82336-3465-4f59-a9e1-77b8d9a01466 backed by image a03b4007-0186-44e1-a560-91d8e58559a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9054e3-2f6a-4af2-abbd-e042e5f1e427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2c82336-3465-4f59-a9e1-77b8d9a01466', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5340693-9984-4869-98a4-ca522e5d0a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:49 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Volume volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 (f2c82336-3465-4f59-a9e1-77b8d9a01466): created successfully Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5340693-9984-4869-98a4-ca522e5d0a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Flow 'volume_create_manager' (bd981c04-d6ce-493f-810a-5eda362ae242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:49 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-9b3c5373-fa6d-4a81-b8ff-6c5b749da5f2 tempest-VolumesExtendTest-1303878999 None] Created volume successfully. Apr 16 14:40:50 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a 1073741824" returned: 0 in 0.495s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:50 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a Apr 16 14:40:50 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:50 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a" returned: 0 in 0.439s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89da166-c4a7-44e4-a592-98e397a0bb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2575833-5bc6-4c75-9b90-160d3f04e7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:50 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Volume volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a (c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a): created successfully Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2575833-5bc6-4c75-9b90-160d3f04e7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Flow 'volume_create_manager' (ac88d7f1-263d-4bfb-b900-55812a1dd186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:50 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-4b2033a1-4c64-4096-aba2-f5a619f76c84 tempest-VolumesTestJSON-646367633 None] Created volume successfully. Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Creating offline snapshot e23bc404-2c20-4584-88f2-e62286d9eaf7 of volume 7b342ac3-f99b-4d19-bff9-10bd62b68d15 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d4e883-3d06-499a-ad55-01db51009b00]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:50 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 Apr 16 14:40:50 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-51e843ef-0dfc-4a47-bf80-fdda70eba799 tempest-VolumesExtendTest-1303878999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Flow 'volume_create_manager' (3b59d817-315e-4ebb-91ec-ae6ea9cc3dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a91db09-dc53-4ca1-99b0-debe7520d6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a91db09-dc53-4ca1-99b0-debe7520d6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1335452605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e13293-8717-490b-b4be-bf54ce0c08a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d877bb99322348bea2c69477a5c75d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:51Z,use_quota=True,user_id='4eeef4ab2b4a4da6a771344321f3b973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdce226-f580-412e-bbd4-64d2e3b43f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdce226-f580-412e-bbd4-64d2e3b43f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc1dedf-1b03-413c-9659-55471dcd1c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc1dedf-1b03-413c-9659-55471dcd1c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e13293-8717-490b-b4be-bf54ce0c08a1', 'volume_name': 'volume-90e13293-8717-490b-b4be-bf54ce0c08a1', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2848eabe-2722-4f7f-89e2-45d98428b6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2848eabe-2722-4f7f-89e2-45d98428b6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a55ef4-e50b-4f4b-be21-11fbba0ae59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:51 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Volume 90e13293-8717-490b-b4be-bf54ce0c08a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e13293-8717-490b-b4be-bf54ce0c08a1', 'volume_size': 1} Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:51 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15" returned: 0 in 0.516s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 2G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:51 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 2G Apr 16 14:40:51 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:51 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 2G" returned: 0 in 0.501s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:51 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 Apr 16 14:40:51 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:52 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7" returned: 0 in 0.444s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:52 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 is being set with open permissions: ugo+rw Apr 16 14:40:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:52 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 Apr 16 14:40:52 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:52 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7" returned: 0 in 0.489s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:52 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.info Apr 16 14:40:52 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:53 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.info" returned: 0 in 0.498s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:53 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.info is being set with open permissions: ugo+rw Apr 16 14:40:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:53 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.info Apr 16 14:40:53 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:53 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.info" returned: 0 in 0.529s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.053s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-51e843ef-0dfc-4a47-bf80-fdda70eba799 tempest-VolumesExtendTest-1303878999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.795s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:53 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-6dfbc243-725a-4953-b7d0-b47704b11b59 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Create snapshot completed successfully Apr 16 14:40:53 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[add62f31-9890-4e5a-8802-c2fbed35ccb2]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-51e843ef-0dfc-4a47-bf80-fdda70eba799 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:53 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 Apr 16 14:40:53 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:54 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-51e843ef-0dfc-4a47-bf80-fdda70eba799 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466" returned: 0 in 0.497s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-51e843ef-0dfc-4a47-bf80-fdda70eba799 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:54 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 Apr 16 14:40:54 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:54 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-51e843ef-0dfc-4a47-bf80-fdda70eba799 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466" returned: 1 in 0.482s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-51e843ef-0dfc-4a47-bf80-fdda70eba799 tempest-VolumesExtendTest-1303878999 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-51e843ef-0dfc-4a47-bf80-fdda70eba799 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 2G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-51e843ef-0dfc-4a47-bf80-fdda70eba799 tempest-VolumesExtendTest-1303878999 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 2G" returned: 0 in 0.046s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-51e843ef-0dfc-4a47-bf80-fdda70eba799 tempest-VolumesExtendTest-1303878999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.055s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.693s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1335452605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e13293-8717-490b-b4be-bf54ce0c08a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d877bb99322348bea2c69477a5c75d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:51Z,use_quota=True,user_id='4eeef4ab2b4a4da6a771344321f3b973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Creating volume 90e13293-8717-490b-b4be-bf54ce0c08a1 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:54 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:54 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1 1073741824 Apr 16 14:40:54 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:54 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-51e843ef-0dfc-4a47-bf80-fdda70eba799 tempest-VolumesExtendTest-1303878999 None] Extend volume completed successfully. Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Acquiring lock "cinder-e23bc404-2c20-4584-88f2-e62286d9eaf7-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "cinder-e23bc404-2c20-4584-88f2-e62286d9eaf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Acquiring lock "cinder-quobyte-7b342ac3-f99b-4d19-bff9-10bd62b68d15" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "cinder-quobyte-7b342ac3-f99b-4d19-bff9-10bd62b68d15" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Acquiring lock "cinder-quobyte-e23bc404-2c20-4584-88f2-e62286d9eaf7" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "cinder-quobyte-e23bc404-2c20-4584-88f2-e62286d9eaf7" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Deleting offline snapshot e23bc404-2c20-4584-88f2-e62286d9eaf7 of volume 7b342ac3-f99b-4d19-bff9-10bd62b68d15 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] snapshot_file for this snap is: volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35effff-4010-4758-835a-6def7a565814]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:54 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 Apr 16 14:40:54 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:55 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1 1073741824" returned: 0 in 0.552s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Acquiring lock "cinder-f2c82336-3465-4f59-a9e1-77b8d9a01466-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Lock "cinder-f2c82336-3465-4f59-a9e1-77b8d9a01466-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:55 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1 Apr 16 14:40:55 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Acquiring lock "cinder-quobyte-f2c82336-3465-4f59-a9e1-77b8d9a01466" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Lock "cinder-quobyte-f2c82336-3465-4f59-a9e1-77b8d9a01466" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f30ede-4810-430e-8e3d-bc6da0463b49]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:55 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7" returned: 0 in 0.583s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2557aa34-0481-400d-b6f7-e628adcbad81]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:55 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 Apr 16 14:40:55 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:55 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 Apr 16 14:40:55 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:55 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1" returned: 0 in 0.498s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a55ef4-e50b-4f4b-be21-11fbba0ae59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e13293-8717-490b-b4be-bf54ce0c08a1', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c2b826-d81d-4ce4-8d36-74a068c8edcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:55 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Volume volume-90e13293-8717-490b-b4be-bf54ce0c08a1 (90e13293-8717-490b-b4be-bf54ce0c08a1): created successfully Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c2b826-d81d-4ce4-8d36-74a068c8edcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Flow 'volume_create_manager' (3b59d817-315e-4ebb-91ec-ae6ea9cc3dbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:55 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5e81d894-2742-4cad-9f93-787ff09c3e64 tempest-VolumesTestJSON-646367633 None] Created volume successfully. Apr 16 14:40:55 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466" returned: 0 in 0.540s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:55 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15" returned: 0 in 0.513s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:55 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 Apr 16 14:40:55 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:56 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 Apr 16 14:40:56 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:56 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466" returned: 1 in 0.571s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:56 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7" returned: 0 in 0.569s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:56 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466 Apr 16 14:40:56 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:56 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7 Apr 16 14:40:56 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Flow 'volume_create_manager' (a2cbf54e-d13a-419c-82fe-5135d94f4a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9122584-6d52-4bb2-b476-c01d38b8bf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9122584-6d52-4bb2-b476-c01d38b8bf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1947679442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf25c074-1d17-4b8e-af82-7b7738c4e4eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d877bb99322348bea2c69477a5c75d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:57Z,use_quota=True,user_id='4eeef4ab2b4a4da6a771344321f3b973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1661009-424f-4ff0-bc86-f072fdc50136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1661009-424f-4ff0-bc86-f072fdc50136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48864f09-2630-4eee-b5e7-33ca18544c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48864f09-2630-4eee-b5e7-33ca18544c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf25c074-1d17-4b8e-af82-7b7738c4e4eb', 'volume_name': 'volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6d444a-272c-43ec-ba5b-3257e9bee824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6d444a-272c-43ec-ba5b-3257e9bee824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb37ac1-2ee2-4e69-a5f2-12fb0814912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:56 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Volume cf25c074-1d17-4b8e-af82-7b7738c4e4eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb', 'volume_size': 1} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1947679442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf25c074-1d17-4b8e-af82-7b7738c4e4eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d877bb99322348bea2c69477a5c75d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:57Z,use_quota=True,user_id='4eeef4ab2b4a4da6a771344321f3b973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Creating volume cf25c074-1d17-4b8e-af82-7b7738c4e4eb {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:56 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:56 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb 1073741824 Apr 16 14:40:56 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:57 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f2c82336-3465-4f59-a9e1-77b8d9a01466" returned: 0 in 0.480s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Lock "cinder-quobyte-f2c82336-3465-4f59-a9e1-77b8d9a01466" released by "delete_volume" :: held 1.631s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:57 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15.e23bc404-2c20-4584-88f2-e62286d9eaf7" returned: 0 in 0.486s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "cinder-quobyte-e23bc404-2c20-4584-88f2-e62286d9eaf7" released by "_delete_snapshot" :: held 2.213s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "cinder-quobyte-7b342ac3-f99b-4d19-bff9-10bd62b68d15" released by "delete_snapshot" :: held 2.225s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Created reservations ['31c68f4a-ffd8-4a62-810f-90b730987401', 'd1f21389-099f-414c-8646-7ec825933426', 'b0300f9a-b839-4f30-b71a-31febf5ac8c2', 'cc15af43-5ad4-4dca-a56b-965531de383f'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Created reservations ['ebd3a614-d16c-48c7-b165-a8a303687413', '063d4408-a125-46a6-b71e-f46ac112b209', '5ffa9f23-a111-4cd2-bfb5-369075765b8b', 'ea1e2a7a-53cf-4fb9-9754-bec5b9e1b755'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:57 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:57 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:57 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Delete snapshot completed successfully. Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d9bb254-554e-4ec3-92c3-b044dec26c4d tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "cinder-e23bc404-2c20-4584-88f2-e62286d9eaf7-delete_snapshot" released by "delete_snapshot" :: held 2.398s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:57 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb 1073741824" returned: 0 in 0.541s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:57 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb Apr 16 14:40:57 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:57 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.435s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:40:57 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Deleted volume successfully. Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0f2a1dd0-b3bf-4ac5-9cea-64ec5dd675db tempest-VolumesExtendTest-1303878999 None] Lock "cinder-f2c82336-3465-4f59-a9e1-77b8d9a01466-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:57 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb" returned: 0 in 0.497s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb37ac1-2ee2-4e69-a5f2-12fb0814912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db68519-ed8c-4881-8d8b-9fe347f56338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Flow 'volume_create_manager' (cd0e7068-3bd4-4b9a-92ef-cb0c7d596938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2789cc6-468e-4a8a-ae8b-68118483a40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2789cc6-468e-4a8a-ae8b-68118483a40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1263188453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258968bd-7355-4643-a6b3-9697df0f36cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8021f620d4629918a53c2004b3f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:58Z,use_quota=True,user_id='cbf156a52cca496c98990261e47ff002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af993bb7-7823-4aff-b9e9-4a1463d58665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af993bb7-7823-4aff-b9e9-4a1463d58665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b921fb87-0417-47b2-906f-6f5af9d36e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b921fb87-0417-47b2-906f-6f5af9d36e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '258968bd-7355-4643-a6b3-9697df0f36cb', 'volume_name': 'volume-258968bd-7355-4643-a6b3-9697df0f36cb', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d113ad-ec71-4ad7-9878-bc35fc42d7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d113ad-ec71-4ad7-9878-bc35fc42d7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10119c83-c2dc-4e93-9db9-738bb0db9e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:57 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Volume 258968bd-7355-4643-a6b3-9697df0f36cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-258968bd-7355-4643-a6b3-9697df0f36cb', 'volume_size': 1} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1263188453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258968bd-7355-4643-a6b3-9697df0f36cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8021f620d4629918a53c2004b3f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:40:58Z,use_quota=True,user_id='cbf156a52cca496c98990261e47ff002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Creating volume 258968bd-7355-4643-a6b3-9697df0f36cb {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:40:57 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:57 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Volume volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb (cf25c074-1d17-4b8e-af82-7b7738c4e4eb): created successfully Apr 16 14:40:57 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb 1073741824 Apr 16 14:40:57 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db68519-ed8c-4881-8d8b-9fe347f56338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Flow 'volume_create_manager' (a2cbf54e-d13a-419c-82fe-5135d94f4a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:57 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-708f5831-f851-4e12-b1ff-4142b5abf64e tempest-VolumesTestJSON-646367633 None] Created volume successfully. Apr 16 14:40:58 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Acquiring lock "cinder-7b342ac3-f99b-4d19-bff9-10bd62b68d15-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:58 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "cinder-7b342ac3-f99b-4d19-bff9-10bd62b68d15-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:58 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Acquiring lock "cinder-quobyte-7b342ac3-f99b-4d19-bff9-10bd62b68d15" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:58 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "cinder-quobyte-7b342ac3-f99b-4d19-bff9-10bd62b68d15" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:58 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[514a4f7b-cd43-4bc6-91f1-0d1f5b9e4272]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:58 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 Apr 16 14:40:58 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:58 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb 1073741824" returned: 0 in 0.761s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:58 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb Apr 16 14:40:58 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:58 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15" returned: 0 in 0.667s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:58 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15 Apr 16 14:40:58 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:59 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb" returned: 0 in 0.512s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10119c83-c2dc-4e93-9db9-738bb0db9e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-258968bd-7355-4643-a6b3-9697df0f36cb', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901e54ed-04a6-48e7-b100-75b8f734c4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:40:59 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Volume volume-258968bd-7355-4643-a6b3-9697df0f36cb (258968bd-7355-4643-a6b3-9697df0f36cb): created successfully Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901e54ed-04a6-48e7-b100-75b8f734c4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Flow 'volume_create_manager' (cd0e7068-3bd4-4b9a-92ef-cb0c7d596938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:40:59 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-aeca714d-9d17-4666-bb92-aca3ecc805fc tempest-VolumesExtendTest-1303878999 None] Created volume successfully. Apr 16 14:40:59 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b342ac3-f99b-4d19-bff9-10bd62b68d15" returned: 0 in 0.536s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "cinder-quobyte-7b342ac3-f99b-4d19-bff9-10bd62b68d15" released by "delete_volume" :: held 1.256s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Created reservations ['906e5148-e4a6-40f4-84d1-1638152030cf', '4ccb31e9-278e-461c-b71a-8a0d372be102', 'bac0cb05-3fd6-4590-82aa-c54446422e81', 'e6f93c20-720a-42a6-9484-9e8f06ee374b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:59 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:40:59 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Acquiring lock "cinder-cf25c074-1d17-4b8e-af82-7b7738c4e4eb-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Lock "cinder-cf25c074-1d17-4b8e-af82-7b7738c4e4eb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Acquiring lock "cinder-quobyte-cf25c074-1d17-4b8e-af82-7b7738c4e4eb" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Lock "cinder-quobyte-cf25c074-1d17-4b8e-af82-7b7738c4e4eb" acquired by "delete_volume" :: waited 0.020s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d59932-ebcc-47d9-b4ea-316d75fe0f63]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:40:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:40:59 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb Apr 16 14:40:59 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] Creating offline snapshot 4936b602-26a2-4120-b515-7dd105145480 of volume 258968bd-7355-4643-a6b3-9697df0f36cb {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf79f8b-82e2-484b-9bf9-d351b69c84f6]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:00 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.603s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:00 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Deleted volume successfully. Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f868a4f-41e2-485a-9a33-11f52514efa4 tempest-VolumesSnapshotNegativeTestJSON-2134069785 None] Lock "cinder-7b342ac3-f99b-4d19-bff9-10bd62b68d15-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:00 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb Apr 16 14:41:00 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:00 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb" returned: 0 in 0.578s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:00 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb Apr 16 14:41:00 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:00 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb" returned: 0 in 0.570s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:00 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 1G Apr 16 14:41:00 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:00 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf25c074-1d17-4b8e-af82-7b7738c4e4eb" returned: 0 in 0.529s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Lock "cinder-quobyte-cf25c074-1d17-4b8e-af82-7b7738c4e4eb" released by "delete_volume" :: held 1.148s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Created reservations ['056a17b4-664d-4d20-af98-e24b19bc076c', '91e34672-2188-460e-8ea8-f9eac3da20f4', '8c204996-ce8f-4408-94b7-14828c6d0fa6', 'f7d9154e-358b-45d6-986d-30467935fc51'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:00 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:00 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:01 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.460s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:01 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Deleted volume successfully. Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8f01ec4a-da28-4146-b67a-085de3d57b4a tempest-VolumesTestJSON-646367633 None] Lock "cinder-cf25c074-1d17-4b8e-af82-7b7738c4e4eb-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:01 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 1G" returned: 0 in 0.801s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258968bd-7355-4643-a6b3-9697df0f36cb -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:01 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258968bd-7355-4643-a6b3-9697df0f36cb -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 Apr 16 14:41:01 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (42c8cdfa-5871-4174-ac62-95a1cf6bce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e841d6-4ebc-461a-9fdf-a2b5bd55013e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e841d6-4ebc-461a-9fdf-a2b5bd55013e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-199484328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec080e9-fbcc-4cae-b825-80f9a3e3a440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:02Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2deca2-2e08-4f28-a534-b648dfd0e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2deca2-2e08-4f28-a534-b648dfd0e247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e41bdec-18d7-4ba6-8122-5a5db0e64cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e41bdec-18d7-4ba6-8122-5a5db0e64cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eec080e9-fbcc-4cae-b825-80f9a3e3a440', 'volume_name': 'volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcab6b52-89f9-4dcd-8ed1-58439dc5e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcab6b52-89f9-4dcd-8ed1-58439dc5e921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8f8b51-0921-4a26-8da9-da224a3c9170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:01 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Volume eec080e9-fbcc-4cae-b825-80f9a3e3a440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440', 'volume_size': 1} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Acquiring lock "cinder-90e13293-8717-490b-b4be-bf54ce0c08a1-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Lock "cinder-90e13293-8717-490b-b4be-bf54ce0c08a1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Acquiring lock "cinder-quobyte-90e13293-8717-490b-b4be-bf54ce0c08a1" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Lock "cinder-quobyte-90e13293-8717-490b-b4be-bf54ce0c08a1" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:02 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258968bd-7355-4643-a6b3-9697df0f36cb -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480" returned: 0 in 0.568s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:02 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 is being set with open permissions: ugo+rw Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e56d31c-0093-403f-bd0f-7653080a3e6b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:02 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 Apr 16 14:41:02 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:02 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1 Apr 16 14:41:02 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:02 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480" returned: 0 in 0.479s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (575d7c8f-1428-46a2-a21f-668f7d7207f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2913f5da-a0ab-40d7-857c-5f179a89bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2913f5da-a0ab-40d7-857c-5f179a89bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-819719870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:02Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688eef97-d2f9-434c-a303-94ce88ef825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688eef97-d2f9-434c-a303-94ce88ef825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6626695-df44-447a-af6c-bd556a273bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6626695-df44-447a-af6c-bd556a273bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed', 'volume_name': 'volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17f6abb-acfa-478b-9eaf-fe0a8143970c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17f6abb-acfa-478b-9eaf-fe0a8143970c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a07ec0d-ec8c-4953-8666-e24563900cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:02 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume 8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed', 'volume_size': 1} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:02 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.info Apr 16 14:41:02 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:02 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1" returned: 0 in 0.628s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:02 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1 Apr 16 14:41:02 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:03 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-90e13293-8717-490b-b4be-bf54ce0c08a1" returned: 0 in 0.401s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Lock "cinder-quobyte-90e13293-8717-490b-b4be-bf54ce0c08a1" released by "delete_volume" :: held 1.059s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:03 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.info" returned: 0 in 0.480s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:03 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.info is being set with open permissions: ugo+rw Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:03 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.info Apr 16 14:41:03 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Created reservations ['761f37eb-59c0-4338-ba6d-f1c69341f7b8', '48bcaf21-d9ef-4e78-96c3-441d3cfe6a3c', 'd308a493-6d33-4cc6-83e0-c70603af0618', '967039a7-7603-48f2-ba4b-d1fb732777b8'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:03 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:03 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:03 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.info" returned: 0 in 0.442s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.483s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.883s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-199484328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec080e9-fbcc-4cae-b825-80f9a3e3a440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:02Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Creating volume eec080e9-fbcc-4cae-b825-80f9a3e3a440 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:03 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:03 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440 1073741824 Apr 16 14:41:03 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:03 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-4181c9ce-1879-4dbe-ba86-78ae197d5a00 tempest-VolumesExtendTest-1303878999 None] Create snapshot completed successfully Apr 16 14:41:03 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.435s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:03 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Deleted volume successfully. Apr 16 14:41:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-41cf7420-cde9-497f-9ca4-0a284206e8f5 tempest-VolumesTestJSON-646367633 None] Lock "cinder-90e13293-8717-490b-b4be-bf54ce0c08a1-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:04 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440 1073741824" returned: 0 in 0.464s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:04 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440 Apr 16 14:41:04 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Acquiring lock "cinder-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Lock "cinder-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Acquiring lock "cinder-quobyte-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Lock "cinder-quobyte-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a" acquired by "delete_volume" :: waited 0.022s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0ba6fa-27f0-4dd6-86f6-b15ec2e07dcf]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b8c33dda-8233-45ad-862c-d241a6387ec3 tempest-VolumesExtendTest-1303878999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:04 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a Apr 16 14:41:04 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:04 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440" returned: 0 in 0.451s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.918s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-819719870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:02Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Creating volume 8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:04 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8f8b51-0921-4a26-8da9-da224a3c9170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b1c324-1a31-450a-808b-610180d799bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:04 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed 1073741824 Apr 16 14:41:04 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Volume volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440 (eec080e9-fbcc-4cae-b825-80f9a3e3a440): created successfully Apr 16 14:41:04 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b1c324-1a31-450a-808b-610180d799bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (42c8cdfa-5871-4174-ac62-95a1cf6bce4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:04 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-bfbc35cc-dd21-42e8-91f1-3aed8db01d55 tempest-VolumesActionsTest-304941038 None] Created volume successfully. Apr 16 14:41:04 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a" returned: 0 in 0.529s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:04 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a Apr 16 14:41:04 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2a5177b2-6488-4554-a0ff-5b6cd4f3ba5e tempest-VolumesActionsTest-304941038 None] Acquiring lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440" by "attach_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2a5177b2-6488-4554-a0ff-5b6cd4f3ba5e tempest-VolumesActionsTest-304941038 None] Lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440" acquired by "attach_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:04 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-2a5177b2-6488-4554-a0ff-5b6cd4f3ba5e tempest-VolumesActionsTest-304941038 None] Attaching volume eec080e9-fbcc-4cae-b825-80f9a3e3a440 to instance 29832993-825b-4c07-a636-37d89f86d02f at mountpoint /dev/vdb on host None. Apr 16 14:41:04 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-2a5177b2-6488-4554-a0ff-5b6cd4f3ba5e tempest-VolumesActionsTest-304941038 None] Attach volume completed successfully. Apr 16 14:41:04 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2a5177b2-6488-4554-a0ff-5b6cd4f3ba5e tempest-VolumesActionsTest-304941038 None] Lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440" released by "attach_volume" :: held 0.057s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:05 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed 1073741824" returned: 0 in 0.522s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:05 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed Apr 16 14:41:05 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:05 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a" returned: 0 in 0.463s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Lock "cinder-quobyte-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a" released by "delete_volume" :: held 1.015s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Created reservations ['f7d9fd6d-68a1-4168-bf74-35df6f3210f3', '5ef6de17-596d-464e-b241-14a35e1befe9', 'ec877913-942e-4d00-a7f3-1de66355412c', '6c2bec0d-25c3-43eb-bdff-455e16f0934c'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:05 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:05 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:05 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed" returned: 0 in 0.424s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b8c33dda-8233-45ad-862c-d241a6387ec3 tempest-VolumesExtendTest-1303878999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.184s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e17932-4935-4292-8b29-737cd0626457]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b8c33dda-8233-45ad-862c-d241a6387ec3 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a07ec0d-ec8c-4953-8666-e24563900cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a96da6-f33a-4639-a1d6-ef23cdd70142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:05 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed (8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed): created successfully Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a96da6-f33a-4639-a1d6-ef23cdd70142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (575d7c8f-1428-46a2-a21f-668f7d7207f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:05 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-6d810e9f-4930-4f81-8c07-a386736e2708 tempest-CreateVolumesFromSnapshotTest-213376834 None] Created volume successfully. Apr 16 14:41:05 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb Apr 16 14:41:05 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:05 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-43871b1e-fded-4cee-b881-04f60826ac3e tempest-VolumesActionsTest-2074342767 None] Terminate volume connection completed successfully. Apr 16 14:41:05 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.523s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:05 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Deleted volume successfully. Apr 16 14:41:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-185f8ec0-5f3b-457f-b552-c87da205c168 tempest-VolumesTestJSON-646367633 None] Lock "cinder-c6803fc2-eef1-445c-9ef3-fc03cfdb6c5a-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:06 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b8c33dda-8233-45ad-862c-d241a6387ec3 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb" returned: 0 in 0.656s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b8c33dda-8233-45ad-862c-d241a6387ec3 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 2G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b8c33dda-8233-45ad-862c-d241a6387ec3 tempest-VolumesExtendTest-1303878999 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 2G" returned: 0 in 0.065s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b8c33dda-8233-45ad-862c-d241a6387ec3 tempest-VolumesExtendTest-1303878999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.738s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.426s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Creating offline snapshot 4a0dbc01-8cb4-4f1e-ac74-e467faf54321 of volume 8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1ce1e5-4afd-4a16-902f-c09566d95165]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-43871b1e-fded-4cee-b881-04f60826ac3e tempest-VolumesActionsTest-2074342767 None] Acquiring lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440-detach_volume" by "detach_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-43871b1e-fded-4cee-b881-04f60826ac3e tempest-VolumesActionsTest-2074342767 None] Lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:06 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b8c33dda-8233-45ad-862c-d241a6387ec3 tempest-VolumesExtendTest-1303878999 None] Extend volume completed successfully. Apr 16 14:41:06 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-43871b1e-fded-4cee-b881-04f60826ac3e tempest-VolumesActionsTest-2074342767 None] Detaching volume eec080e9-fbcc-4cae-b825-80f9a3e3a440 from instance 29832993-825b-4c07-a636-37d89f86d02f. Apr 16 14:41:06 devstack sudo[88635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed Apr 16 14:41:06 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:06 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-43871b1e-fded-4cee-b881-04f60826ac3e tempest-VolumesActionsTest-2074342767 None] Detach volume completed successfully. Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-43871b1e-fded-4cee-b881-04f60826ac3e tempest-VolumesActionsTest-2074342767 None] Lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Acquiring lock "cinder-4936b602-26a2-4120-b515-7dd105145480-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Lock "cinder-4936b602-26a2-4120-b515-7dd105145480-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Acquiring lock "cinder-quobyte-258968bd-7355-4643-a6b3-9697df0f36cb" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Lock "cinder-quobyte-258968bd-7355-4643-a6b3-9697df0f36cb" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Acquiring lock "cinder-quobyte-4936b602-26a2-4120-b515-7dd105145480" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Lock "cinder-quobyte-4936b602-26a2-4120-b515-7dd105145480" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Deleting offline snapshot 4936b602-26a2-4120-b515-7dd105145480 of volume 258968bd-7355-4643-a6b3-9697df0f36cb {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] snapshot_file for this snap is: volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4573a5-b228-4d40-98b4-9d77760371d0]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:06 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 Apr 16 14:41:06 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:06 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed" returned: 0 in 0.615s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:07 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 1G Apr 16 14:41:07 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-051c805a-d080-4f80-9324-e1e9d2bcdb1a tempest-VolumesActionsTest-304941038 None] Acquiring lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440-detach_volume" by "detach_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-051c805a-d080-4f80-9324-e1e9d2bcdb1a tempest-VolumesActionsTest-304941038 None] Lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:07 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-051c805a-d080-4f80-9324-e1e9d2bcdb1a tempest-VolumesActionsTest-304941038 None] Volume detach called, but volume not attached. Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-051c805a-d080-4f80-9324-e1e9d2bcdb1a tempest-VolumesActionsTest-304941038 None] Lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:07 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480" returned: 0 in 0.558s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258968bd-7355-4643-a6b3-9697df0f36cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41a5141-9799-47ee-9815-3c52042ac633]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:07 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb Apr 16 14:41:07 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:07 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 1G" returned: 0 in 0.804s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:07 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 Apr 16 14:41:07 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Acquiring lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Acquiring lock "cinder-quobyte-eec080e9-fbcc-4cae-b825-80f9a3e3a440" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Lock "cinder-quobyte-eec080e9-fbcc-4cae-b825-80f9a3e3a440" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced15d74-0c16-43a7-9f46-a03bcf56160d]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:07 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb" returned: 0 in 0.730s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:08 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 Apr 16 14:41:08 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:08 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440 Apr 16 14:41:08 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:08 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321" returned: 0 in 0.772s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:08 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 is being set with open permissions: ugo+rw Apr 16 14:41:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:08 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 Apr 16 14:41:08 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:08 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480" returned: 0 in 0.624s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:08 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480 Apr 16 14:41:08 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:08 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440" returned: 0 in 0.887s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:08 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440 Apr 16 14:41:08 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:09 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb.4936b602-26a2-4120-b515-7dd105145480" returned: 0 in 0.467s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Lock "cinder-quobyte-4936b602-26a2-4120-b515-7dd105145480" released by "_delete_snapshot" :: held 2.448s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Lock "cinder-quobyte-258968bd-7355-4643-a6b3-9697df0f36cb" released by "delete_snapshot" :: held 2.461s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Created reservations ['e7ffcaa8-d729-4c63-b607-5fc27154519c', '8569777a-93cf-4f1c-b7bd-ec7677db2f33', 'cb0f2289-4b1f-4e1b-a4df-26bb6c0581db', '38d92185-db9f-4361-98eb-c9bbc20bac5e'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:09 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321" returned: 0 in 0.703s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:09 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Delete snapshot completed successfully. Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f6f4d01-22e2-4e21-b8f4-89205004cc21 tempest-VolumesExtendTest-1303878999 None] Lock "cinder-4936b602-26a2-4120-b515-7dd105145480-delete_snapshot" released by "delete_snapshot" :: held 2.629s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:09 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.info Apr 16 14:41:09 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:09 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-bb791c66-1db7-4eff-879b-441d9a59b0cc tempest-GroupsV314Test-999031512 None] Group tempest-GroupsV314Test-Group-1164534711: creating Apr 16 14:41:09 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-bb791c66-1db7-4eff-879b-441d9a59b0cc tempest-GroupsV314Test-999031512 None] Group tempest-GroupsV314Test-Group-1164534711: created successfully Apr 16 14:41:09 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:09 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-bb791c66-1db7-4eff-879b-441d9a59b0cc tempest-GroupsV314Test-999031512 None] Create group completed successfully. Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eec080e9-fbcc-4cae-b825-80f9a3e3a440" returned: 0 in 0.688s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Lock "cinder-quobyte-eec080e9-fbcc-4cae-b825-80f9a3e3a440" released by "delete_volume" :: held 1.609s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Created reservations ['8c40925c-fe12-4311-b8bb-1a668d264f30', '4046b0d7-5f6d-4193-93f2-cd404a5683a1', 'ac03aed2-1f98-48dd-954e-f215f8778f1e', '36dac7bf-709c-47c3-b64f-4975a642b011'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:09 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:09 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:09 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.info" returned: 0 in 0.495s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:09 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.info is being set with open permissions: ugo+rw Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:09 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.info Apr 16 14:41:09 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Acquiring lock "cinder-258968bd-7355-4643-a6b3-9697df0f36cb-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Lock "cinder-258968bd-7355-4643-a6b3-9697df0f36cb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Acquiring lock "cinder-quobyte-258968bd-7355-4643-a6b3-9697df0f36cb" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Lock "cinder-quobyte-258968bd-7355-4643-a6b3-9697df0f36cb" acquired by "delete_volume" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3a27fb-8d25-41f5-aca5-003150c78c51]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:10 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.503s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:10 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Deleted volume successfully. Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b700c2af-5477-4096-8e70-e9e82abdc76d tempest-VolumesActionsTest-304941038 None] Lock "cinder-eec080e9-fbcc-4cae-b825-80f9a3e3a440-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:10 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb Apr 16 14:41:10 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:10 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.info" returned: 0 in 0.520s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.046s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:10 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-390356ae-2ff5-41b1-b03b-f51b5792d7a6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Create snapshot completed successfully Apr 16 14:41:10 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb" returned: 0 in 0.569s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:10 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb Apr 16 14:41:10 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Flow 'volume_create_manager' (93adbc66-ea62-4a9f-bb59-ee9886d42023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac3331b-4ba0-4671-a68f-879cd93013dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac3331b-4ba0-4671-a68f-879cd93013dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1341538583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d9692ce-28fe-4206-b98a-634c49e34aa5,host='devstack@QuobyteHD#QuobyteHD',id=e6bb9d0b-006c-4cb2-b742-a78127532452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47d6a2ef039402c9219677c3bdab83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:11Z,use_quota=True,user_id='fa4bc012d8c94dae92ad0e20a58d7948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2d7f036-630f-491c-884d-80cad03395f5),volume_type_id=b2d7f036-630f-491c-884d-80cad03395f5)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2dd1c7c-b922-4eb9-b972-1934a5ebcc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2dd1c7c-b922-4eb9-b972-1934a5ebcc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465d6b81-1bbd-4137-a184-71c5e70105d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465d6b81-1bbd-4137-a184-71c5e70105d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6bb9d0b-006c-4cb2-b742-a78127532452', 'volume_name': 'volume-e6bb9d0b-006c-4cb2-b742-a78127532452', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9efe6d4-9421-4e72-9dd2-4b7499aea6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9efe6d4-9421-4e72-9dd2-4b7499aea6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff148bc-9404-4d89-a675-2a577440c8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:10 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Volume e6bb9d0b-006c-4cb2-b742-a78127532452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6bb9d0b-006c-4cb2-b742-a78127532452', 'volume_size': 1} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d9692ce-28fe-4206-b98a-634c49e34aa5,created_at=2026-04-16T12:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1341538583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d9692ce-28fe-4206-b98a-634c49e34aa5,host='devstack@QuobyteHD#QuobyteHD',id=e6bb9d0b-006c-4cb2-b742-a78127532452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47d6a2ef039402c9219677c3bdab83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:11Z,use_quota=True,user_id='fa4bc012d8c94dae92ad0e20a58d7948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2d7f036-630f-491c-884d-80cad03395f5),volume_type_id=b2d7f036-630f-491c-884d-80cad03395f5)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Creating volume e6bb9d0b-006c-4cb2-b742-a78127532452 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:10 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:10 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 1073741824 Apr 16 14:41:10 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:11 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-258968bd-7355-4643-a6b3-9697df0f36cb" returned: 0 in 0.533s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Lock "cinder-quobyte-258968bd-7355-4643-a6b3-9697df0f36cb" released by "delete_volume" :: held 1.140s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Created reservations ['2910d12b-08ce-4b05-a393-fbc327a829bd', '8897fcf8-2bf5-446e-8306-9db0f2e548f6', 'e790a21a-5e61-4cc2-ac54-039320ace324', '5837a2b5-d755-47a7-bc81-29f66bb261c3'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:11 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:11 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (d180de3a-2526-4219-a989-38e3f582efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a098c4-0eb8-4679-8ba4-199b6278ba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a098c4-0eb8-4679-8ba4-199b6278ba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1178991349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e63787-993c-48c5-b955-fee188830265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:11Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7864aa-0cd3-4b19-ac25-facdcba00c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7864aa-0cd3-4b19-ac25-facdcba00c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f659c53-8436-4268-8fcf-26b491dcba55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f659c53-8436-4268-8fcf-26b491dcba55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e63787-993c-48c5-b955-fee188830265', 'volume_name': 'volume-96e63787-993c-48c5-b955-fee188830265', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1ae2c6-a057-4f7a-ac7a-1731a6937fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1ae2c6-a057-4f7a-ac7a-1731a6937fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd8dc75-652c-47cb-8217-9e44bf46f077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:11 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume 96e63787-993c-48c5-b955-fee188830265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e63787-993c-48c5-b955-fee188830265', 'volume_size': 1} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:11 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 1073741824" returned: 0 in 0.901s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:UPDATE=224,cinder:SELECT=188,cinder:INSERT=54,cinder:DELETE=13 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:11 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 Apr 16 14:41:11 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (51fa107c-5b33-4774-92cc-c06bd095386e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7b4bb1-e80b-4328-947e-b216db7eb2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7b4bb1-e80b-4328-947e-b216db7eb2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2091245195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b8a40b-75df-4f81-b444-2b87555d1798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:12Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab8c77b-3d48-44f3-bae2-374b9f103aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab8c77b-3d48-44f3-bae2-374b9f103aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ab02b2-315b-4e8b-8878-6f1a487f3e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ab02b2-315b-4e8b-8878-6f1a487f3e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b8a40b-75df-4f81-b444-2b87555d1798', 'volume_name': 'volume-29b8a40b-75df-4f81-b444-2b87555d1798', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25eacca8-110c-44e7-b2c5-a617a22b79b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25eacca8-110c-44e7-b2c5-a617a22b79b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55defda9-3020-4a1f-85af-0ef8200e50ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:11 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume 29b8a40b-75df-4f81-b444-2b87555d1798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b8a40b-75df-4f81-b444-2b87555d1798', 'volume_size': 1} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:11 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.711s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:11 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Deleted volume successfully. Apr 16 14:41:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ee3572db-0121-4602-a4c6-70cb3389586d tempest-VolumesExtendTest-1303878999 None] Lock "cinder-258968bd-7355-4643-a6b3-9697df0f36cb-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (4f50b935-50bb-4f88-b0f3-e91461b0a6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cf5867-497b-4e2c-bdef-49c9900e9e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cf5867-497b-4e2c-bdef-49c9900e9e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-316836181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1423aaac-822f-49a7-896a-3baae5ab4cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:12Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc8ae2f-72ca-4382-8af8-05d080265124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc8ae2f-72ca-4382-8af8-05d080265124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d445f4e7-6772-4d7b-a8e1-1e585ab1dcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d445f4e7-6772-4d7b-a8e1-1e585ab1dcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1423aaac-822f-49a7-896a-3baae5ab4cd0', 'volume_name': 'volume-1423aaac-822f-49a7-896a-3baae5ab4cd0', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6fad73-aa27-4c4d-8e57-bfcc52b03fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6fad73-aa27-4c4d-8e57-bfcc52b03fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f773a5ec-273c-493d-9ea7-1f697833ea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume 1423aaac-822f-49a7-896a-3baae5ab4cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1423aaac-822f-49a7-896a-3baae5ab4cd0', 'volume_size': 1} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (c0605098-ed83-46e0-86fc-49d9e1624c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f53951-050b-4ed1-9ae7-a38880aa023d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f53951-050b-4ed1-9ae7-a38880aa023d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1325639206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13079bc5-54b3-4747-9837-1396b0fb1ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:12Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cef44b0-60b7-4d7d-8f5d-38d5a608586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cef44b0-60b7-4d7d-8f5d-38d5a608586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1e070a-38a4-473e-9497-fb3e72e17782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1e070a-38a4-473e-9497-fb3e72e17782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13079bc5-54b3-4747-9837-1396b0fb1ae2', 'volume_name': 'volume-13079bc5-54b3-4747-9837-1396b0fb1ae2', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc0214a-73f7-4412-89ef-106be3afe8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc0214a-73f7-4412-89ef-106be3afe8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881f33ef-c63c-41b2-a906-5516f70d0ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume 13079bc5-54b3-4747-9837-1396b0fb1ae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13079bc5-54b3-4747-9837-1396b0fb1ae2', 'volume_size': 1} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452" returned: 0 in 0.562s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1178991349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e63787-993c-48c5-b955-fee188830265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:11Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Creating volume 96e63787-993c-48c5-b955-fee188830265 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:12 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=176,cinder:INSERT=68,cinder:UPDATE=231,cinder:DELETE=24 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff148bc-9404-4d89-a675-2a577440c8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6bb9d0b-006c-4cb2-b742-a78127532452', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123b3d96-2d0f-44cf-b370-2d64dbdae311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Volume volume-e6bb9d0b-006c-4cb2-b742-a78127532452 (e6bb9d0b-006c-4cb2-b742-a78127532452): created successfully Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123b3d96-2d0f-44cf-b370-2d64dbdae311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Flow 'volume_create_manager' (93adbc66-ea62-4a9f-bb59-ee9886d42023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:12 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-d4a059cc-54a1-4313-b584-4b40bb07e684 tempest-GroupsV314Test-999031512 None] Created volume successfully. Apr 16 14:41:12 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265 1073741824 Apr 16 14:41:12 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (46cca316-8d50-491f-9096-ea1b5c0283f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbcec91-e7d4-4ed4-b8ca-464fba6f420a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbcec91-e7d4-4ed4-b8ca-464fba6f420a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-981147697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5257a1-ac5b-4ea7-9b90-64959f52d50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:13Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39c021b-c33e-4b8f-a287-2e765386a4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39c021b-c33e-4b8f-a287-2e765386a4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7caebc-d3f7-4d87-9ba4-d240346cabbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7caebc-d3f7-4d87-9ba4-d240346cabbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b5257a1-ac5b-4ea7-9b90-64959f52d50d', 'volume_name': 'volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d00ac7-55ef-43f3-a533-dc09cd14e098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d00ac7-55ef-43f3-a533-dc09cd14e098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e927aa98-65bc-4c8e-aa56-c0d2d47cf888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:12 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume 7b5257a1-ac5b-4ea7-9b90-64959f52d50d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d', 'volume_size': 1} Apr 16 14:41:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:13 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265 1073741824" returned: 0 in 0.697s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:13 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265 Apr 16 14:41:13 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:13 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265" returned: 0 in 0.496s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.691s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2091245195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b8a40b-75df-4f81-b444-2b87555d1798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:12Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Creating volume 29b8a40b-75df-4f81-b444-2b87555d1798 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:13 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:13 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798 1073741824 Apr 16 14:41:13 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd8dc75-652c-47cb-8217-9e44bf46f077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e63787-993c-48c5-b955-fee188830265', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f181056a-cb8b-4677-93c6-b5aae3a04ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:13 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume volume-96e63787-993c-48c5-b955-fee188830265 (96e63787-993c-48c5-b955-fee188830265): created successfully Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f181056a-cb8b-4677-93c6-b5aae3a04ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (d180de3a-2526-4219-a989-38e3f582efbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:13 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-40c1b78c-287c-4b44-809f-60203d6148c8 tempest-CreateVolumesFromSnapshotTest-213376834 None] Created volume successfully. Apr 16 14:41:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Flow 'volume_create_manager' (82f9180a-9621-493c-a3e1-025e1762a384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aadde3a-1298-4773-af05-267f95a2f8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aadde3a-1298-4773-af05-267f95a2f8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1960838152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd30e40c-9b61-4b15-9439-3ac6ec074e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e3cb45420f425c92a6bc88f63e94b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:14Z,use_quota=True,user_id='38b81860d07d49cabfbfcb0f70ffbae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4509e15d-1769-43ff-a38f-56046f1a8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4509e15d-1769-43ff-a38f-56046f1a8278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58134d85-73a8-480f-bcd6-f28b6639a555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58134d85-73a8-480f-bcd6-f28b6639a555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd30e40c-9b61-4b15-9439-3ac6ec074e43', 'volume_name': 'volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f1efe9-944e-4e68-84eb-1b6bf68bc66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f1efe9-944e-4e68-84eb-1b6bf68bc66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9264ac-5c06-430f-ad1d-fa9b35011427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:14 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Volume bd30e40c-9b61-4b15-9439-3ac6ec074e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43', 'volume_size': 1} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:14 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798 1073741824" returned: 0 in 0.624s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:14 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798 Apr 16 14:41:14 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:14 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798" returned: 0 in 0.443s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.582s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-316836181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1423aaac-822f-49a7-896a-3baae5ab4cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:12Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Creating volume 1423aaac-822f-49a7-896a-3baae5ab4cd0 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:14 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55defda9-3020-4a1f-85af-0ef8200e50ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b8a40b-75df-4f81-b444-2b87555d1798', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:14 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0 1073741824 Apr 16 14:41:14 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ff1ad4-fe66-461c-bfaf-d21988515692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:14 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume volume-29b8a40b-75df-4f81-b444-2b87555d1798 (29b8a40b-75df-4f81-b444-2b87555d1798): created successfully Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ff1ad4-fe66-461c-bfaf-d21988515692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (51fa107c-5b33-4774-92cc-c06bd095386e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:14 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-455d7b8b-bbba-415c-97ce-e14013bfff20 tempest-CreateVolumesFromSnapshotTest-213376834 None] Created volume successfully. Apr 16 14:41:15 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0 1073741824" returned: 0 in 0.491s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:15 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0 Apr 16 14:41:15 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:15 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0" returned: 0 in 0.410s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.274s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1325639206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13079bc5-54b3-4747-9837-1396b0fb1ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:12Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Creating volume 13079bc5-54b3-4747-9837-1396b0fb1ae2 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:15 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:15 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2 1073741824 Apr 16 14:41:15 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f773a5ec-273c-493d-9ea7-1f697833ea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1423aaac-822f-49a7-896a-3baae5ab4cd0', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95372a3c-2f9d-4f20-87c1-d5dd98e8308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:15 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume volume-1423aaac-822f-49a7-896a-3baae5ab4cd0 (1423aaac-822f-49a7-896a-3baae5ab4cd0): created successfully Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95372a3c-2f9d-4f20-87c1-d5dd98e8308f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (4f50b935-50bb-4f88-b0f3-e91461b0a6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:15 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-8c200836-226a-4769-8fe6-b43aa2ce1446 tempest-CreateVolumesFromSnapshotTest-213376834 None] Created volume successfully. Apr 16 14:41:16 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2 1073741824" returned: 0 in 0.505s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:16 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2 Apr 16 14:41:16 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:16 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2" returned: 0 in 0.473s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.978s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-981147697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5257a1-ac5b-4ea7-9b90-64959f52d50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9296f9e3a3cb4f5f97024d41e9ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:13Z,use_quota=True,user_id='cd7a4f30000a4fbbb00bb5cbab4769b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Creating volume 7b5257a1-ac5b-4ea7-9b90-64959f52d50d {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:16 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:16 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d 1073741824 Apr 16 14:41:16 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (f9176732-447f-4e42-b9e3-ad113c78f6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8811e88e-bbc1-45d0-95ad-a15402332aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8811e88e-bbc1-45d0-95ad-a15402332aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847591235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d82767-9586-414b-b8f4-550ac126d27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:17Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98320785-1892-447f-ab9a-aa91d228c8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98320785-1892-447f-ab9a-aa91d228c8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ab5813-430e-4d96-b270-daa37c327b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ab5813-430e-4d96-b270-daa37c327b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d82767-9586-414b-b8f4-550ac126d27b', 'volume_name': 'volume-82d82767-9586-414b-b8f4-550ac126d27b', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69acf004-7695-484a-a1ca-62e9d2542b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69acf004-7695-484a-a1ca-62e9d2542b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2666640-eef5-4a07-9b95-4767f29d8341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:16 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Volume 82d82767-9586-414b-b8f4-550ac126d27b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d82767-9586-414b-b8f4-550ac126d27b', 'volume_size': 1} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881f33ef-c63c-41b2-a906-5516f70d0ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13079bc5-54b3-4747-9837-1396b0fb1ae2', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f79dbc0-7188-42d5-b340-efeac497bb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:16 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume volume-13079bc5-54b3-4747-9837-1396b0fb1ae2 (13079bc5-54b3-4747-9837-1396b0fb1ae2): created successfully Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f79dbc0-7188-42d5-b340-efeac497bb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (c0605098-ed83-46e0-86fc-49d9e1624c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:16 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cae83114-f406-499c-a456-7f3c0b48cb72 tempest-CreateVolumesFromSnapshotTest-213376834 None] Created volume successfully. Apr 16 14:41:17 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d 1073741824" returned: 0 in 0.495s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:17 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d Apr 16 14:41:17 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:17 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d" returned: 0 in 0.401s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.721s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:17 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Cloning volume e6bb9d0b-006c-4cb2-b742-a78127532452 to volume d17df714-83cf-4d27-afe5-851a4c990992 Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Creating offline snapshot a3c5b20a-ad95-4382-b487-e52a013cba37 of volume e6bb9d0b-006c-4cb2-b742-a78127532452 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e927aa98-65bc-4c8e-aa56-c0d2d47cf888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c02235c-1942-4a04-84b9-292759c68623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5f8f34-e5b6-4b1a-a6c9-c1ea56c60956]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:17 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Volume volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d (7b5257a1-ac5b-4ea7-9b90-64959f52d50d): created successfully Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c02235c-1942-4a04-84b9-292759c68623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Flow 'volume_create_manager' (46cca316-8d50-491f-9096-ea1b5c0283f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:17 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-16af890c-ac75-43ac-b797-4f9616d67b18 tempest-CreateVolumesFromSnapshotTest-213376834 None] Created volume successfully. Apr 16 14:41:17 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 Apr 16 14:41:17 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-7b5257a1-ac5b-4ea7-9b90-64959f52d50d-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-7b5257a1-ac5b-4ea7-9b90-64959f52d50d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-quobyte-7b5257a1-ac5b-4ea7-9b90-64959f52d50d" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-7b5257a1-ac5b-4ea7-9b90-64959f52d50d" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b97ee1-0e1b-4246-b0a6-cf9f3d604a06]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:18 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452" returned: 0 in 0.488s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:18 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 1G Apr 16 14:41:18 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:18 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d Apr 16 14:41:18 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:18 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d" returned: 0 in 0.504s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:18 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d Apr 16 14:41:18 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:18 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 1G" returned: 0 in 0.528s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6bb9d0b-006c-4cb2-b742-a78127532452 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:18 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6bb9d0b-006c-4cb2-b742-a78127532452 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 Apr 16 14:41:18 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:18 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-7b5257a1-ac5b-4ea7-9b90-64959f52d50d" returned: 0 in 0.420s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-7b5257a1-ac5b-4ea7-9b90-64959f52d50d" released by "delete_volume" :: held 0.954s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:18 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Created reservations ['4f3a6bb1-b651-47b7-a3aa-7ec20f2482b0', 'df50494f-ae84-4729-9571-8b783cf6c804', '0a19395a-f5db-4808-aa32-0f516e913e2d', '8ad69eb6-6f41-49a9-8bd7-edffc455a733'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:19 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:19 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:19 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6bb9d0b-006c-4cb2-b742-a78127532452 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37" returned: 0 in 0.453s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:19 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:19 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 Apr 16 14:41:19 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-13079bc5-54b3-4747-9837-1396b0fb1ae2-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-13079bc5-54b3-4747-9837-1396b0fb1ae2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-quobyte-13079bc5-54b3-4747-9837-1396b0fb1ae2" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-13079bc5-54b3-4747-9837-1396b0fb1ae2" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab975fc-63c2-4e8d-a9ef-b1cdc64e8f4e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:19 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2 Apr 16 14:41:19 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:19 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.421s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:19 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Deleted volume successfully. Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa9b9b1a-a563-40e2-b602-e0cadee693bd tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-7b5257a1-ac5b-4ea7-9b90-64959f52d50d-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:19 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37" returned: 0 in 0.457s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:19 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.info Apr 16 14:41:19 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:19 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2" returned: 0 in 0.492s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:19 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2 Apr 16 14:41:19 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:19 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.info" returned: 0 in 0.424s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:19 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:41:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:19 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.info Apr 16 14:41:19 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:20 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-13079bc5-54b3-4747-9837-1396b0fb1ae2" returned: 0 in 0.419s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-13079bc5-54b3-4747-9837-1396b0fb1ae2" released by "delete_volume" :: held 0.934s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Created reservations ['00bfa4fe-5a65-469d-b7c7-9aded60414de', '4ca7dc27-06b6-494f-9dd7-ab6764fa5b03', '0b3fbbe1-e206-4da2-b317-da7ad932ed87', '6db50355-5aaf-43de-b58a-e37d717be2a1'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:20 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:20 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-1423aaac-822f-49a7-896a-3baae5ab4cd0-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-1423aaac-822f-49a7-896a-3baae5ab4cd0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-quobyte-1423aaac-822f-49a7-896a-3baae5ab4cd0" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-1423aaac-822f-49a7-896a-3baae5ab4cd0" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e394ff-88a9-4611-9152-faff7f5b1dbe]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:20 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0 Apr 16 14:41:20 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:20 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.info" returned: 0 in 0.431s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Acquiring lock "cinder-quobyte-d17df714-83cf-4d27-afe5-851a4c990992" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Lock "cinder-quobyte-d17df714-83cf-4d27-afe5-851a4c990992" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] snapshot: a3c5b20a-ad95-4382-b487-e52a013cba37, volume: d17df714-83cf-4d27-afe5-851a4c990992, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09f2325-2e51-49ae-bdbc-8e64d98b842d]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:20 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 Apr 16 14:41:20 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:20 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.457s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:20 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Deleted volume successfully. Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1300d2f5-c9be-4ab4-8975-549960c1bba0 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-13079bc5-54b3-4747-9837-1396b0fb1ae2-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:20 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0" returned: 0 in 0.557s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:20 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0 Apr 16 14:41:20 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:20 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37" returned: 0 in 0.468s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6bb9d0b-006c-4cb2-b742-a78127532452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d777f49b-106a-4112-b91a-574ff13c20b7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:20 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 Apr 16 14:41:20 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:21 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1423aaac-822f-49a7-896a-3baae5ab4cd0" returned: 0 in 0.412s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-1423aaac-822f-49a7-896a-3baae5ab4cd0" released by "delete_volume" :: held 0.990s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Created reservations ['036153a4-245e-43be-9cd0-193ad284be9b', 'be912a2d-3500-41c2-9e39-814d7b65deec', '08d42538-605a-4327-922b-9e3e85b741d2', '45390d07-9ccb-4f3f-93bf-edd290099cc2'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:21 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:21 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-29b8a40b-75df-4f81-b444-2b87555d1798-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-29b8a40b-75df-4f81-b444-2b87555d1798-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:21 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452" returned: 0 in 0.488s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992 not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:21 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992 Apr 16 14:41:21 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-quobyte-29b8a40b-75df-4f81-b444-2b87555d1798" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-29b8a40b-75df-4f81-b444-2b87555d1798" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3748f9f-6751-435f-ada7-f9233eefbb46]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:21 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798 Apr 16 14:41:21 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:21 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.470s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:21 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Deleted volume successfully. Apr 16 14:41:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9fb10cf2-161c-4958-bb8d-7403450eb68d tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-1423aaac-822f-49a7-896a-3baae5ab4cd0-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:22 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798" returned: 0 in 0.591s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:22 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798 Apr 16 14:41:22 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:23 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-29b8a40b-75df-4f81-b444-2b87555d1798" returned: 0 in 1.251s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-29b8a40b-75df-4f81-b444-2b87555d1798" released by "delete_volume" :: held 1.880s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Created reservations ['bd5c78f8-a779-4f04-bd8b-c35838c82560', '175e9f59-228a-4e44-954a-c88cacb41563', '15a40ef9-5a32-4399-a1b6-a574e8337f90', '1a0794db-fab9-4c40-b2a1-7de2793c8ed1'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:23 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:23 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:23 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992" returned: 0 in 2.150s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5792afe-f40e-4ad7-a01e-3a4bcc1f3849]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-96e63787-993c-48c5-b955-fee188830265-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-96e63787-993c-48c5-b955-fee188830265-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-quobyte-96e63787-993c-48c5-b955-fee188830265" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-96e63787-993c-48c5-b955-fee188830265" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabff879-f73f-4085-aa24-3f636a768f3f]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:23 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 Apr 16 14:41:23 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:23 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265 Apr 16 14:41:23 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:23 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.464s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:23 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Deleted volume successfully. Apr 16 14:41:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-33c50df2-9909-4ed3-826e-db0bd98787d6 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-29b8a40b-75df-4f81-b444-2b87555d1798-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:24 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265" returned: 0 in 0.490s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:24 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265 Apr 16 14:41:24 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:24 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452" returned: 0 in 0.687s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992 {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:41:24 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Converted 1024.00 MB image at 475.87 MB/s Apr 16 14:41:24 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:24 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992 Apr 16 14:41:24 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:24 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96e63787-993c-48c5-b955-fee188830265" returned: 0 in 0.387s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-96e63787-993c-48c5-b955-fee188830265" released by "delete_volume" :: held 0.903s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Created reservations ['5480fee0-650c-4e20-9444-f4661ad8968b', 'a41171c1-3ede-43de-83f3-c5d1a3d45573', '3feda4a8-7f75-4e1a-8518-92f7890d3157', 'f6f668d0-55dc-405a-adec-683e142ad68b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:24 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992" returned: 0 in 0.410s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Lock "cinder-quobyte-d17df714-83cf-4d27-afe5-851a4c990992" released by "_copy_volume_from_snapshot" :: held 4.249s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Acquiring lock "cinder-quobyte-a3c5b20a-ad95-4382-b487-e52a013cba37" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Lock "cinder-quobyte-a3c5b20a-ad95-4382-b487-e52a013cba37" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:24 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Deleting offline snapshot a3c5b20a-ad95-4382-b487-e52a013cba37 of volume e6bb9d0b-006c-4cb2-b742-a78127532452 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:41:24 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] snapshot_file for this snap is: volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4e6db4-ef52-495f-8bc9-c7ed7847c597]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-4a0dbc01-8cb4-4f1e-ac74-e467faf54321-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-4a0dbc01-8cb4-4f1e-ac74-e467faf54321-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-quobyte-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-quobyte-4a0dbc01-8cb4-4f1e-ac74-e467faf54321" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-4a0dbc01-8cb4-4f1e-ac74-e467faf54321" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Deleting offline snapshot 4a0dbc01-8cb4-4f1e-ac74-e467faf54321 of volume 8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] snapshot_file for this snap is: volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:41:24 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 Apr 16 14:41:24 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d18071-39ef-4a1d-af64-5892b6f01e5d]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:24 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 Apr 16 14:41:24 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:25 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.428s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:25 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Deleted volume successfully. Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-885c7a90-42eb-4761-913d-3d16b6a72057 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-96e63787-993c-48c5-b955-fee188830265-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:25 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37" returned: 0 in 0.505s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6bb9d0b-006c-4cb2-b742-a78127532452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed593b9-5f89-46d4-91bd-d4f63acfc173]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:25 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 Apr 16 14:41:25 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:25 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321" returned: 0 in 0.501s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[528dc661-0b66-48be-8b50-ec3557bb82f4]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:25 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed Apr 16 14:41:25 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:25 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452" returned: 0 in 0.476s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:25 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 Apr 16 14:41:25 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:25 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed" returned: 0 in 0.482s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:25 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 Apr 16 14:41:25 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:26 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37" returned: 0 in 0.459s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:26 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37 Apr 16 14:41:26 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:26 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321" returned: 0 in 0.464s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:26 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321 Apr 16 14:41:26 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:26 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452.a3c5b20a-ad95-4382-b487-e52a013cba37" returned: 0 in 0.404s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Lock "cinder-quobyte-a3c5b20a-ad95-4382-b487-e52a013cba37" released by "_delete_snapshot" :: held 1.896s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.079s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.442s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1960838152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd30e40c-9b61-4b15-9439-3ac6ec074e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e3cb45420f425c92a6bc88f63e94b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:14Z,use_quota=True,user_id='38b81860d07d49cabfbfcb0f70ffbae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Creating volume bd30e40c-9b61-4b15-9439-3ac6ec074e43 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:26 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:26 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 1073741824 Apr 16 14:41:26 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:26 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5a6e274d-acdb-49ec-a91d-e2ffab2d0ae8 tempest-GroupsV314Test-999031512 None] Create group from source-group-6d9692ce-28fe-4206-b98a-634c49e34aa5 completed successfully. Apr 16 14:41:26 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed.4a0dbc01-8cb4-4f1e-ac74-e467faf54321" returned: 0 in 0.427s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-4a0dbc01-8cb4-4f1e-ac74-e467faf54321" released by "_delete_snapshot" :: held 1.932s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed" released by "delete_snapshot" :: held 1.944s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Created reservations ['e3fe4cfc-dde9-496c-9298-04c2dbe1ac5f', '205fa5fb-7155-4488-b423-853902bc8934', '535f3fc2-c5f0-4fbf-8f83-76b9d06ec207', 'ebb8b1e8-0ce8-455b-b70b-465bfc602a45'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:26 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Delete snapshot completed successfully. Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6f331765-5390-434c-8230-5df84d42c383 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-4a0dbc01-8cb4-4f1e-ac74-e467faf54321-delete_snapshot" released by "delete_snapshot" :: held 2.028s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "cinder-quobyte-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8485057-a8c6-4930-a960-8258f4fd986f]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:27 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed Apr 16 14:41:27 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Acquiring lock "cinder-quobyte-d17df714-83cf-4d27-afe5-851a4c990992" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Lock "cinder-quobyte-d17df714-83cf-4d27-afe5-851a4c990992" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad02eb1d-634f-40e2-8f6d-46c2c8778e88]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:27 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 1073741824" returned: 0 in 0.571s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:27 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 Apr 16 14:41:27 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:27 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992 Apr 16 14:41:27 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:27 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed" returned: 0 in 0.541s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:27 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed Apr 16 14:41:27 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:27 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43" returned: 0 in 0.424s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.951s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847591235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d82767-9586-414b-b8f4-550ac126d27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:17Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Creating volume 82d82767-9586-414b-b8f4-550ac126d27b {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:27 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:27 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9264ac-5c06-430f-ad1d-fa9b35011427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ed088b-bae8-474b-a16a-7005948cbc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:27 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b 1073741824 Apr 16 14:41:27 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992" returned: 0 in 0.504s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:27 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Volume volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 (bd30e40c-9b61-4b15-9439-3ac6ec074e43): created successfully Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ed088b-bae8-474b-a16a-7005948cbc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Flow 'volume_create_manager' (82f9180a-9621-493c-a3e1-025e1762a384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:27 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992 Apr 16 14:41:27 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:27 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-07316211-9bbf-4ffd-9392-b6568ce762e7 tempest-VolumeDependencyTests-1802724007 None] Created volume successfully. Apr 16 14:41:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:28 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed" returned: 0 in 0.504s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-quobyte-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed" released by "delete_volume" :: held 1.083s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Created reservations ['32082d89-2a5b-41a0-bdec-ec1f89f92595', 'aec03cea-8cc7-4b31-8541-c7a4051c7301', '905fca67-51b4-4187-8393-f65a1b4ca9a0', '81a74b95-75d4-440e-85c6-f8e27f6e2387'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:28 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d17df714-83cf-4d27-afe5-851a4c990992" returned: 0 in 0.476s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:28 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Lock "cinder-quobyte-d17df714-83cf-4d27-afe5-851a4c990992" released by "delete_volume" :: held 1.005s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b 1073741824" returned: 0 in 0.520s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:28 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:28 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:28 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b Apr 16 14:41:28 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Created reservations ['b428a78d-6bfb-4dd9-8914-3ae81ec43e02'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:28 devstack cinder-volume[83305]: WARNING cinder.quota [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-120044685 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-120044685, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:41:28 devstack cinder-volume[83305]: WARNING cinder.quota [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-120044685 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-120044685, it is now deprecated. Please use the default quota class for default quota. Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Created reservations ['3e3ab874-72dd-486a-baf7-00fa636a03bc', '3729df61-9b30-4688-8f3c-c22400f049eb', '0e8eb2d4-cf75-4e34-b821-0949566cf4fe', 'a53cab83-2d60-4e11-9262-3c9aca30b07b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:28 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:28 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:28 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.467s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:28 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Deleted volume successfully. Apr 16 14:41:28 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b" returned: 0 in 0.411s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-535548c2-a06f-4d82-9dc0-b94bf3d3b007 tempest-CreateVolumesFromSnapshotTest-213376834 None] Lock "cinder-8c65b4e6-138d-4bd4-9e01-7fdcee0bb2ed-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.657s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2666640-eef5-4a07-9b95-4767f29d8341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d82767-9586-414b-b8f4-550ac126d27b', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375f4427-d56d-43b2-a9a9-5bbb2dcb96c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] Creating offline snapshot c92d66db-7b66-4973-bac6-0ebc601fff0e of volume bd30e40c-9b61-4b15-9439-3ac6ec074e43 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:41:28 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Volume volume-82d82767-9586-414b-b8f4-550ac126d27b (82d82767-9586-414b-b8f4-550ac126d27b): created successfully Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375f4427-d56d-43b2-a9a9-5bbb2dcb96c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (f9176732-447f-4e42-b9e3-ad113c78f6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e85524-b927-41b9-abfa-1b02b4d4c691]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:28 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-0e12f414-61c2-454f-a111-88d64a788040 tempest-VolumesActionsTest-304941038 None] Created volume successfully. Apr 16 14:41:28 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.409s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:28 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:28 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 Apr 16 14:41:28 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:28 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-60969e0a-fb14-4e2f-8465-1d4f10677963 tempest-GroupsV314Test-999031512 None] Delete group completed successfully. Apr 16 14:41:29 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43" returned: 0 in 0.472s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:29 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e 1G Apr 16 14:41:29 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Acquiring lock "cinder-82d82767-9586-414b-b8f4-550ac126d27b-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Lock "cinder-82d82767-9586-414b-b8f4-550ac126d27b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Acquiring lock "cinder-quobyte-e6bb9d0b-006c-4cb2-b742-a78127532452" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Acquiring lock "cinder-quobyte-82d82767-9586-414b-b8f4-550ac126d27b" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Lock "cinder-quobyte-e6bb9d0b-006c-4cb2-b742-a78127532452" acquired by "delete_volume" :: waited 0.030s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Lock "cinder-quobyte-82d82767-9586-414b-b8f4-550ac126d27b" acquired by "delete_volume" :: waited 0.037s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d6670c-8abf-445c-9179-b9c839e73503]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8858f51b-0c89-4c59-90fa-046462337043]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:29 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 Apr 16 14:41:29 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:29 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b Apr 16 14:41:29 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:29 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e 1G" returned: 0 in 0.632s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:29 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e Apr 16 14:41:29 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:30 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b" returned: 0 in 0.556s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:30 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b Apr 16 14:41:30 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:30 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452" returned: 0 in 0.648s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:30 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452 Apr 16 14:41:30 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:30 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e" returned: 0 in 0.570s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:30 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e is being set with open permissions: ugo+rw Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:30 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e Apr 16 14:41:30 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:30 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82d82767-9586-414b-b8f4-550ac126d27b" returned: 0 in 0.586s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Lock "cinder-quobyte-82d82767-9586-414b-b8f4-550ac126d27b" released by "delete_volume" :: held 1.170s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Created reservations ['f583bbd2-c342-4640-bcf7-dcb2aca0fbc1', '305af4a4-a05a-4045-a246-fa8879af82fa', '9bd20c26-7698-43d7-90e7-68b7f7ad8cdb', 'c5e7a0c9-c960-4fc6-96a0-9915d7b3ec87'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:30 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e6bb9d0b-006c-4cb2-b742-a78127532452" returned: 0 in 0.554s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Lock "cinder-quobyte-e6bb9d0b-006c-4cb2-b742-a78127532452" released by "delete_volume" :: held 1.246s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Created reservations ['d789e8eb-f287-437a-ba6f-44b6cf735d74'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:30 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:30 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Created reservations ['d97ddeef-18b7-4c55-8499-6fca4b19b5b1', 'c3e3295b-9fdc-458a-b1c3-b8954109859f', 'c2d12c2f-d5d5-4ffe-bd6d-d9754693e124', '170c1b7d-95d4-4778-b3c1-cde1037b98a1'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:30 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e" returned: 0 in 0.631s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:31 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:31 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:31 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.info Apr 16 14:41:31 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:31 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.530s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:31 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Deleted volume successfully. Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3017542-631d-4cb3-aa18-54b1e7a79584 tempest-VolumesActionsTest-2074342767 None] Lock "cinder-82d82767-9586-414b-b8f4-550ac126d27b-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:31 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.546s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:31 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-23e9590e-4c1a-43f1-8689-7d7fc6b8175a tempest-GroupsV314Test-999031512 None] Delete group completed successfully. Apr 16 14:41:31 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.info" returned: 0 in 0.523s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:31 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.info is being set with open permissions: ugo+rw Apr 16 14:41:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:31 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.info Apr 16 14:41:31 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (9d73f5b2-e70d-4e03-a1ce-3a923070e68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3ffcbe-909b-4ebc-bf45-055653b01b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3ffcbe-909b-4ebc-bf45-055653b01b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-688334258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1120e1f-9448-4e04-8f2d-a879e85dbec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:32Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5449ce4-eb87-48b7-91a2-c848de235aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5449ce4-eb87-48b7-91a2-c848de235aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2aa0825-f3c4-426e-b165-eb7ed758e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2aa0825-f3c4-426e-b165-eb7ed758e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1120e1f-9448-4e04-8f2d-a879e85dbec9', 'volume_name': 'volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e6035a-a8e9-40ce-b513-d4f59a14287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e6035a-a8e9-40ce-b513-d4f59a14287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54310fa-fc4a-481f-a4ba-95d0bd8da96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:32 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Volume d1120e1f-9448-4e04-8f2d-a879e85dbec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9', 'volume_size': 1} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:32 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.info" returned: 0 in 0.552s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.481s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.040s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-688334258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1120e1f-9448-4e04-8f2d-a879e85dbec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:32Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Creating volume d1120e1f-9448-4e04-8f2d-a879e85dbec9 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:32 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:32 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9 1073741824 Apr 16 14:41:32 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:32 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-fd11fdd3-d396-455a-a71f-50a415b739e3 tempest-VolumeDependencyTests-1802724007 None] Create snapshot completed successfully Apr 16 14:41:32 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9 1073741824" returned: 0 in 0.602s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:32 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9 Apr 16 14:41:32 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:33 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9" returned: 0 in 0.560s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54310fa-fc4a-481f-a4ba-95d0bd8da96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e101e1-0f9a-4e4f-b8ab-a7beacbe4f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:33 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Volume volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9 (d1120e1f-9448-4e04-8f2d-a879e85dbec9): created successfully Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e101e1-0f9a-4e4f-b8ab-a7beacbe4f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (9d73f5b2-e70d-4e03-a1ce-3a923070e68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:33 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a18b6691-9efb-4fbd-82c2-011902ebb16f tempest-VolumesActionsTest-304941038 None] Created volume successfully. Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Flow 'volume_create_manager' (fdd4a25f-37e3-4207-9f17-66aad4a394c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8063b165-b485-41bb-94f6-9254a41da45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8063b165-b485-41bb-94f6-9254a41da45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1150783056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47763017-a8bc-482d-84d4-d5f9c5fcb04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e3cb45420f425c92a6bc88f63e94b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c92d66db-7b66-4973-bac6-0ebc601fff0e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:34Z,use_quota=True,user_id='38b81860d07d49cabfbfcb0f70ffbae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fab5ca-6d70-4fe8-9323-94e69b928a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fab5ca-6d70-4fe8-9323-94e69b928a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c567ae5d-aa4f-4226-a273-99c7230f1053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c567ae5d-aa4f-4226-a273-99c7230f1053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47763017-a8bc-482d-84d4-d5f9c5fcb04e', 'volume_name': 'volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e', 'volume_size': 1, 'snapshot_id': 'c92d66db-7b66-4973-bac6-0ebc601fff0e'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570d71b2-12db-45af-a883-c92fd4155ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570d71b2-12db-45af-a883-c92fd4155ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff67c599-da91-42b6-83f6-18eb845e62c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:33 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Volume 47763017-a8bc-482d-84d4-d5f9c5fcb04e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e', 'volume_size': 1, 'snapshot_id': 'c92d66db-7b66-4973-bac6-0ebc601fff0e'} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-quobyte-c92d66db-7b66-4973-bac6-0ebc601fff0e-47763017-a8bc-482d-84d4-d5f9c5fcb04e" by "_create_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-c92d66db-7b66-4973-bac6-0ebc601fff0e-47763017-a8bc-482d-84d4-d5f9c5fcb04e" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Creating volume 47763017-a8bc-482d-84d4-d5f9c5fcb04e from snapshot c92d66db-7b66-4973-bac6-0ebc601fff0e {{(pid=83305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-quobyte-47763017-a8bc-482d-84d4-d5f9c5fcb04e" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-47763017-a8bc-482d-84d4-d5f9c5fcb04e" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] snapshot: c92d66db-7b66-4973-bac6-0ebc601fff0e, volume: 47763017-a8bc-482d-84d4-d5f9c5fcb04e, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d90c4a6-ee0b-49c1-9f9e-09edaad10def]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:33 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e Apr 16 14:41:33 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Acquiring lock "cinder-d1120e1f-9448-4e04-8f2d-a879e85dbec9-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Lock "cinder-d1120e1f-9448-4e04-8f2d-a879e85dbec9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Acquiring lock "cinder-quobyte-d1120e1f-9448-4e04-8f2d-a879e85dbec9" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Lock "cinder-quobyte-d1120e1f-9448-4e04-8f2d-a879e85dbec9" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d79f0cc-904f-4d9f-9bd1-4aa0a1bb0787]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:34 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e" returned: 0 in 0.716s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ff6cff-573d-4f9e-959b-da3787f7664c]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:34 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9 Apr 16 14:41:34 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:34 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 Apr 16 14:41:34 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:35 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43" returned: 0 in 0.558s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:35 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:41:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:35 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e Apr 16 14:41:35 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:35 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9" returned: 0 in 0.791s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:35 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9 Apr 16 14:41:35 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:36 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d1120e1f-9448-4e04-8f2d-a879e85dbec9" returned: 0 in 0.941s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Lock "cinder-quobyte-d1120e1f-9448-4e04-8f2d-a879e85dbec9" released by "delete_volume" :: held 1.783s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:36 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Created reservations ['111bb905-4c7c-47a6-9259-1b7169765666', '13a517f6-7281-487e-ac4d-0b0074058af9', 'b5d2301e-070c-4b00-be53-6d34bfed5a0c', 'ad6dee93-2450-4886-8d56-a8a2c833f378'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:36 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:36 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:37 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (a8805703-ea7e-45f8-95b6-1bfa5acc1481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b136b3c-6a75-4517-bbd3-665677e7bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b136b3c-6a75-4517-bbd3-665677e7bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1006389703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691f48ff-94c3-415e-a367-a88175a92ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:38Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7008c3f2-9d7d-4c6b-9d0d-312e0f8339e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7008c3f2-9d7d-4c6b-9d0d-312e0f8339e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9ff7f3-79d6-40a8-8f72-9743485bf04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9ff7f3-79d6-40a8-8f72-9743485bf04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691f48ff-94c3-415e-a367-a88175a92ac8', 'volume_name': 'volume-691f48ff-94c3-415e-a367-a88175a92ac8', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715066e9-a384-4571-bd5b-50fb8409b89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715066e9-a384-4571-bd5b-50fb8409b89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28eb34f-a82a-4638-a381-2ab86f576cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:37 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Volume 691f48ff-94c3-415e-a367-a88175a92ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691f48ff-94c3-415e-a367-a88175a92ac8', 'volume_size': 1} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e" returned: 0 in 2.749s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aeb920-ec2c-4e74-844a-b239fe224a8b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:37 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 1.491s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:37 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Deleted volume successfully. Apr 16 14:41:37 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-453a504a-624b-42ce-8d29-299e73625ace tempest-VolumesActionsTest-2074342767 None] Lock "cinder-d1120e1f-9448-4e04-8f2d-a879e85dbec9-delete_volume" released by "delete_volume" :: held 3.592s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:37 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 Apr 16 14:41:37 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:38 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43" returned: 0 in 0.875s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:38 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43, size 1024.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:41:38 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Converted 1024.00 MB image at 372.46 MB/s Apr 16 14:41:38 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e is being set with open permissions: ugo+rw Apr 16 14:41:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:38 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e Apr 16 14:41:38 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:39 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e" returned: 0 in 0.602s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-47763017-a8bc-482d-84d4-d5f9c5fcb04e" released by "_copy_volume_from_snapshot" :: held 5.563s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-c92d66db-7b66-4973-bac6-0ebc601fff0e-47763017-a8bc-482d-84d4-d5f9c5fcb04e" released by "_create_volume_from_snapshot" :: held 5.584s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.593s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.501s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1006389703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691f48ff-94c3-415e-a367-a88175a92ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:38Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Creating volume 691f48ff-94c3-415e-a367-a88175a92ac8 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:39 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff67c599-da91-42b6-83f6-18eb845e62c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e', 'volume_size': 1, 'snapshot_id': 'c92d66db-7b66-4973-bac6-0ebc601fff0e'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e535ca1-749f-4b1f-85c5-06fbe50fc876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:39 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8 1073741824 Apr 16 14:41:39 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Volume volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e (47763017-a8bc-482d-84d4-d5f9c5fcb04e): created successfully Apr 16 14:41:39 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e535ca1-749f-4b1f-85c5-06fbe50fc876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Flow 'volume_create_manager' (fdd4a25f-37e3-4207-9f17-66aad4a394c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:39 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-7b6750e6-f573-4687-bb54-2f272c276180 tempest-VolumeDependencyTests-1802724007 None] Created volume successfully. Apr 16 14:41:40 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8 1073741824" returned: 0 in 0.649s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:40 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8 Apr 16 14:41:40 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:40 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8" returned: 0 in 0.486s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28eb34f-a82a-4638-a381-2ab86f576cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691f48ff-94c3-415e-a367-a88175a92ac8', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b9edb5-a475-44c4-8346-7ae67046705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-c92d66db-7b66-4973-bac6-0ebc601fff0e-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:40 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Volume volume-691f48ff-94c3-415e-a367-a88175a92ac8 (691f48ff-94c3-415e-a367-a88175a92ac8): created successfully Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b9edb5-a475-44c4-8346-7ae67046705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (a8805703-ea7e-45f8-95b6-1bfa5acc1481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:40 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-4b439cf5-53ae-46e1-9e9d-e67074dfd801 tempest-VolumesActionsTest-304941038 None] Created volume successfully. Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-c92d66db-7b66-4973-bac6-0ebc601fff0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-quobyte-bd30e40c-9b61-4b15-9439-3ac6ec074e43" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-bd30e40c-9b61-4b15-9439-3ac6ec074e43" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-quobyte-c92d66db-7b66-4973-bac6-0ebc601fff0e" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-c92d66db-7b66-4973-bac6-0ebc601fff0e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Deleting offline snapshot c92d66db-7b66-4973-bac6-0ebc601fff0e of volume bd30e40c-9b61-4b15-9439-3ac6ec074e43 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] snapshot_file for this snap is: volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3c0511-2d1a-4d6a-b848-da5b50343784]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:40 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e Apr 16 14:41:40 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Acquiring lock "cinder-691f48ff-94c3-415e-a367-a88175a92ac8-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Lock "cinder-691f48ff-94c3-415e-a367-a88175a92ac8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Acquiring lock "cinder-quobyte-691f48ff-94c3-415e-a367-a88175a92ac8" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Lock "cinder-quobyte-691f48ff-94c3-415e-a367-a88175a92ac8" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[197390b3-85e9-4056-9e80-45fc122f1594]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:41 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8 Apr 16 14:41:41 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:41 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e" returned: 0 in 0.602s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:41:41 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b9b225-fc63-4c7e-8a60-a0ff793b7c2e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:41 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 Apr 16 14:41:41 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:41 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8" returned: 0 in 0.639s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:41 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8 Apr 16 14:41:41 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:41 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43" returned: 0 in 0.560s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:41 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e Apr 16 14:41:41 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:42 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-691f48ff-94c3-415e-a367-a88175a92ac8" returned: 0 in 0.519s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Lock "cinder-quobyte-691f48ff-94c3-415e-a367-a88175a92ac8" released by "delete_volume" :: held 1.180s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Created reservations ['64faee7d-40ee-4075-9256-9806b75e62be', 'd14e5b97-0e5b-405a-b70c-d99b774c81e2', 'd296b4e3-a667-4890-ad2b-9271b875088d', '93ed8847-5711-4f6a-befb-e1a643197872'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:42 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:42 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:42 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e" returned: 0 in 0.540s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:42 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e Apr 16 14:41:42 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:42 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.502s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:42 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Deleted volume successfully. Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c76af424-32b8-41d4-a720-eff0acf2c2a5 tempest-VolumesActionsTest-2074342767 None] Lock "cinder-691f48ff-94c3-415e-a367-a88175a92ac8-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:42 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43.c92d66db-7b66-4973-bac6-0ebc601fff0e" returned: 0 in 0.511s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-c92d66db-7b66-4973-bac6-0ebc601fff0e" released by "_delete_snapshot" :: held 2.275s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-bd30e40c-9b61-4b15-9439-3ac6ec074e43" released by "delete_snapshot" :: held 2.286s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Created reservations ['16ff5085-1907-4e14-bb10-caf65e27e21c', '5260e614-55bb-4fd5-8784-3d556b29b53c', '93d7f01a-ba86-4895-88fe-555738a550cb', 'a30ec553-fadf-49b9-93c0-2ea1f78edab0'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:42 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Delete snapshot completed successfully. Apr 16 14:41:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-edc2a5f0-dfe9-441b-8462-f7be4a0cf424 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-c92d66db-7b66-4973-bac6-0ebc601fff0e-delete_snapshot" released by "delete_snapshot" :: held 2.389s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (715461ec-693c-404b-9645-8c7c0aca6c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83082601-36f4-412a-ab59-1095a46974db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83082601-36f4-412a-ab59-1095a46974db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1046784536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f592d498-ca47-4e55-a88d-04442d5a5d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:43Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7213bca2-cb49-4a2f-a629-c54f0e102ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7213bca2-cb49-4a2f-a629-c54f0e102ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4cd071-ce20-4cba-914e-1bc32401c820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4cd071-ce20-4cba-914e-1bc32401c820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f592d498-ca47-4e55-a88d-04442d5a5d88', 'volume_name': 'volume-f592d498-ca47-4e55-a88d-04442d5a5d88', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9dbf1b-3f0c-467e-9c19-032300515ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9dbf1b-3f0c-467e-9c19-032300515ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49a3b8c-4817-4db4-b0f7-7dc0d0159a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:43 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Volume f592d498-ca47-4e55-a88d-04442d5a5d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f592d498-ca47-4e55-a88d-04442d5a5d88', 'volume_size': 1} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1046784536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f592d498-ca47-4e55-a88d-04442d5a5d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:43Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Creating volume f592d498-ca47-4e55-a88d-04442d5a5d88 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:43 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:43 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88 1073741824 Apr 16 14:41:43 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-bd30e40c-9b61-4b15-9439-3ac6ec074e43-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-bd30e40c-9b61-4b15-9439-3ac6ec074e43-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-quobyte-bd30e40c-9b61-4b15-9439-3ac6ec074e43" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-bd30e40c-9b61-4b15-9439-3ac6ec074e43" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[72770834-d3fa-4f2c-909d-0d50deb82f73]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:43 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 Apr 16 14:41:43 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:44 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88 1073741824" returned: 0 in 0.707s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:44 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88 Apr 16 14:41:44 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:44 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43" returned: 0 in 0.554s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:44 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43 Apr 16 14:41:44 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:44 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88" returned: 0 in 0.483s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49a3b8c-4817-4db4-b0f7-7dc0d0159a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f592d498-ca47-4e55-a88d-04442d5a5d88', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbdf87e-0a76-49bc-9b7a-4fef94a2e15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:44 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Volume volume-f592d498-ca47-4e55-a88d-04442d5a5d88 (f592d498-ca47-4e55-a88d-04442d5a5d88): created successfully Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbdf87e-0a76-49bc-9b7a-4fef94a2e15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (715461ec-693c-404b-9645-8c7c0aca6c61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:44 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-62334ab0-989e-430a-8221-b24e5afa0232 tempest-VolumesActionsTest-304941038 None] Created volume successfully. Apr 16 14:41:44 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-bd30e40c-9b61-4b15-9439-3ac6ec074e43" returned: 0 in 0.507s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-bd30e40c-9b61-4b15-9439-3ac6ec074e43" released by "delete_volume" :: held 1.101s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:44 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Created reservations ['787134b0-0510-4d09-9fe0-5c24d01af50f', '66dab8dd-a98c-43b8-bc93-ac27e5070a47', '0e1dc3bf-1953-44c1-95b4-d21c3000687d', '4dd83726-5e3d-4be5-8c26-cb00a42ce695'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:45 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:45 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:45 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.486s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:45 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Deleted volume successfully. Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df1c81c4-60c2-42a8-8fbd-e9373a39b926 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-bd30e40c-9b61-4b15-9439-3ac6ec074e43-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Acquiring lock "cinder-f592d498-ca47-4e55-a88d-04442d5a5d88-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Lock "cinder-f592d498-ca47-4e55-a88d-04442d5a5d88-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Acquiring lock "cinder-quobyte-f592d498-ca47-4e55-a88d-04442d5a5d88" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Lock "cinder-quobyte-f592d498-ca47-4e55-a88d-04442d5a5d88" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f48f4ea-09b1-41c3-986a-d139395f6f13]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:45 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88 Apr 16 14:41:45 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Flow 'volume_create_manager' (6d713397-5f08-4684-acd9-e8a51d62110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce9d217-9ac8-49e8-82b0-38592d3f2bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:46 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce9d217-9ac8-49e8-82b0-38592d3f2bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1058946424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d026861-140f-4923-a6b1-2da8436fdfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e3cb45420f425c92a6bc88f63e94b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:46Z,use_quota=True,user_id='38b81860d07d49cabfbfcb0f70ffbae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deec1c3-b031-4521-b5ba-dc71736e80ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deec1c3-b031-4521-b5ba-dc71736e80ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72e6d2d-b18b-41dc-8fac-b02dab3c3774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72e6d2d-b18b-41dc-8fac-b02dab3c3774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d026861-140f-4923-a6b1-2da8436fdfee', 'volume_name': 'volume-1d026861-140f-4923-a6b1-2da8436fdfee', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c7b318-a431-4f6d-b108-e9db8574d5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c7b318-a431-4f6d-b108-e9db8574d5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46a1496-7bbd-417f-9326-fba4583a3871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:46 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Volume 1d026861-140f-4923-a6b1-2da8436fdfee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d026861-140f-4923-a6b1-2da8436fdfee', 'volume_size': 1} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1058946424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d026861-140f-4923-a6b1-2da8436fdfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e3cb45420f425c92a6bc88f63e94b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:46Z,use_quota=True,user_id='38b81860d07d49cabfbfcb0f70ffbae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Creating volume 1d026861-140f-4923-a6b1-2da8436fdfee {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:46 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88" returned: 0 in 0.673s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:46 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee 1073741824 Apr 16 14:41:46 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:46 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88 Apr 16 14:41:46 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_service.periodic_task [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:46 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:46 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:47 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.572s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:47 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee 1073741824" returned: 0 in 0.767s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:47 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee Apr 16 14:41:47 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:47 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f592d498-ca47-4e55-a88d-04442d5a5d88" returned: 0 in 0.908s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Lock "cinder-quobyte-f592d498-ca47-4e55-a88d-04442d5a5d88" released by "delete_volume" :: held 1.609s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Created reservations ['2351f2e9-91c5-4cd8-8f1c-68f6c36c83da', '02233c66-6614-4a17-ae4d-474165eef2c9', 'a492987c-d03f-4a27-acd5-07ac83a36e6e', '31a2e83a-0faa-44ca-b03c-1e0717edeffc'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:47 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:47 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:47 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee" returned: 0 in 0.514s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46a1496-7bbd-417f-9326-fba4583a3871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d026861-140f-4923-a6b1-2da8436fdfee', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a86f307-7456-4def-bab1-5e158f6128e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:47 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Volume volume-1d026861-140f-4923-a6b1-2da8436fdfee (1d026861-140f-4923-a6b1-2da8436fdfee): created successfully Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a86f307-7456-4def-bab1-5e158f6128e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Flow 'volume_create_manager' (6d713397-5f08-4684-acd9-e8a51d62110d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:47 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-11ad0b51-44ed-4d19-9845-4afcfbb286af tempest-VolumeDependencyTests-1802724007 None] Created volume successfully. Apr 16 14:41:47 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.513s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:47 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:47 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Deleted volume successfully. Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b70af334-2e98-4bdb-b229-73632c75c78d tempest-VolumesActionsTest-2074342767 None] Lock "cinder-f592d498-ca47-4e55-a88d-04442d5a5d88-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (52db68b8-2541-463e-b304-573415832436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1e1cfe-b8d0-49ce-b0c2-0b90234a1b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1e1cfe-b8d0-49ce-b0c2-0b90234a1b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2007809326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df530c1-8610-4d68-8089-df1639343662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:48Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184cccd0-a9ca-4570-a79f-804ea03e514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184cccd0-a9ca-4570-a79f-804ea03e514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6a2038-0e4e-44b6-ae86-4b01f31e8461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6a2038-0e4e-44b6-ae86-4b01f31e8461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df530c1-8610-4d68-8089-df1639343662', 'volume_name': 'volume-6df530c1-8610-4d68-8089-df1639343662', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0003225-a475-44e7-8934-9472e96c6947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0003225-a475-44e7-8934-9472e96c6947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c72ef7-4ffd-4ba2-837d-e7bdfde084e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Volume 6df530c1-8610-4d68-8089-df1639343662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df530c1-8610-4d68-8089-df1639343662', 'volume_size': 1} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2007809326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df530c1-8610-4d68-8089-df1639343662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6acddf21e284c5a9d33fd7dcba3c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:48Z,use_quota=True,user_id='5515933faf0647189ffe3c4b7b986d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Creating volume 6df530c1-8610-4d68-8089-df1639343662 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:48 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:48 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662 1073741824 Apr 16 14:41:48 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Flow 'volume_create_manager' (a738dd70-42ea-414c-a3e2-bd6618b01182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f39612a-d781-4e3e-9872-7179d0f71f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f39612a-d781-4e3e-9872-7179d0f71f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1995157228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63113e0-75ee-4e9c-a22a-1bff718316cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eaab53687a0416d89fb2cdd3b4916c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:48Z,use_quota=True,user_id='09c62bb2a4ed4c5d8535a7a4055856ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b629ec4d-34bb-43e3-95fa-a762541f8b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b629ec4d-34bb-43e3-95fa-a762541f8b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7730530-f5b6-4057-821e-77d84b60a69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7730530-f5b6-4057-821e-77d84b60a69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63113e0-75ee-4e9c-a22a-1bff718316cd', 'volume_name': 'volume-b63113e0-75ee-4e9c-a22a-1bff718316cd', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb55eb5-24c1-4f90-a1d7-9f4be53baea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb55eb5-24c1-4f90-a1d7-9f4be53baea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd1e96c-142c-4ca0-92a1-5cb74fd55e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Volume b63113e0-75ee-4e9c-a22a-1bff718316cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63113e0-75ee-4e9c-a22a-1bff718316cd', 'volume_size': 1} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Flow 'volume_create_manager' (aa3ae280-c91e-43be-8a51-4bd37e10231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95036b0-3617-4ba1-bae1-ef7b8f63fa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95036b0-3617-4ba1-bae1-ef7b8f63fa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-291874970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e3cb45420f425c92a6bc88f63e94b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1d026861-140f-4923-a6b1-2da8436fdfee,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:49Z,use_quota=True,user_id='38b81860d07d49cabfbfcb0f70ffbae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4366feda-259d-4c1b-bbfa-b4e1bd3f8cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4366feda-259d-4c1b-bbfa-b4e1bd3f8cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdc3f55-6690-4c28-be1f-8a968300d158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdc3f55-6690-4c28-be1f-8a968300d158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac', 'volume_name': 'volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac', 'volume_size': 1, 'source_volid': '1d026861-140f-4923-a6b1-2da8436fdfee', 'source_volstatus': 'available'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4940816b-b2a6-463f-ba3f-5400cf54b555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4940816b-b2a6-463f-ba3f-5400cf54b555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a007261-c425-438d-ae31-05d1cf86c0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:48 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Volume eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac', 'volume_size': 1, 'source_volid': '1d026861-140f-4923-a6b1-2da8436fdfee', 'source_volstatus': 'available'} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662 1073741824" returned: 0 in 0.592s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:48 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662 Apr 16 14:41:48 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:49 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662" returned: 0 in 0.460s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1995157228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63113e0-75ee-4e9c-a22a-1bff718316cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eaab53687a0416d89fb2cdd3b4916c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:48Z,use_quota=True,user_id='09c62bb2a4ed4c5d8535a7a4055856ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Creating volume b63113e0-75ee-4e9c-a22a-1bff718316cd {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:49 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c72ef7-4ffd-4ba2-837d-e7bdfde084e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df530c1-8610-4d68-8089-df1639343662', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:49 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd 1073741824 Apr 16 14:41:49 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdcf074-fbca-4831-a884-f2cb43fc967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:49 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Volume volume-6df530c1-8610-4d68-8089-df1639343662 (6df530c1-8610-4d68-8089-df1639343662): created successfully Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdcf074-fbca-4831-a884-f2cb43fc967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Flow 'volume_create_manager' (52db68b8-2541-463e-b304-573415832436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:49 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-92f8e2c0-6242-4df6-8326-13051b2e9809 tempest-VolumesActionsTest-304941038 None] Created volume successfully. Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Flow 'volume_create_manager' (e3990c3a-06d8-463d-893d-7fd57ac734b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:49 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b8f03c-addf-4d56-a8dd-6c536f534063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd 1073741824" returned: 0 in 0.562s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b8f03c-addf-4d56-a8dd-6c536f534063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-733796771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44843990-e20e-4611-9c1c-f30a67b3da0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8192eb97f7846098b1d958cd03b573a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:50Z,use_quota=True,user_id='4dd34d9c7488424d961dec09587ccfa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92638825-346b-4443-844b-8ec85b7fb93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92638825-346b-4443-844b-8ec85b7fb93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6f0a19-aad2-41c9-98d0-1912cd21034b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6f0a19-aad2-41c9-98d0-1912cd21034b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44843990-e20e-4611-9c1c-f30a67b3da0f', 'volume_name': 'volume-44843990-e20e-4611-9c1c-f30a67b3da0f', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ad6563-d80e-40d7-a82d-f291db62d727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ad6563-d80e-40d7-a82d-f291db62d727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac480b80-2430-4906-98ac-2af2262f56e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:49 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Volume 44843990-e20e-4611-9c1c-f30a67b3da0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44843990-e20e-4611-9c1c-f30a67b3da0f', 'volume_size': 1} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:50 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd Apr 16 14:41:50 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:50 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd" returned: 0 in 0.417s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.522s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:50 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Cloning volume 1d026861-140f-4923-a6b1-2da8436fdfee to volume eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd1e96c-142c-4ca0-92a1-5cb74fd55e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63113e0-75ee-4e9c-a22a-1bff718316cd', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843008f1-09f1-49a0-9d82-79189a7777cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:50 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Volume volume-b63113e0-75ee-4e9c-a22a-1bff718316cd (b63113e0-75ee-4e9c-a22a-1bff718316cd): created successfully Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843008f1-09f1-49a0-9d82-79189a7777cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Flow 'volume_create_manager' (a738dd70-42ea-414c-a3e2-bd6618b01182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:50 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-442b39a8-6163-442e-b027-ab2f84730d5f tempest-SnapshotDependencyTests-635596744 None] Created volume successfully. Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Creating offline snapshot e75c0cb1-db4c-44f7-b6e9-780ae26d518b of volume 1d026861-140f-4923-a6b1-2da8436fdfee {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a989187c-77c1-4674-9735-5fad5378502b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:50 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee Apr 16 14:41:50 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Acquiring lock "cinder-6df530c1-8610-4d68-8089-df1639343662-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Lock "cinder-6df530c1-8610-4d68-8089-df1639343662-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Acquiring lock "cinder-quobyte-6df530c1-8610-4d68-8089-df1639343662" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Lock "cinder-quobyte-6df530c1-8610-4d68-8089-df1639343662" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afb52eb-1abe-4d76-aea7-61b0bbb103dc]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:50 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662 Apr 16 14:41:50 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:51 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee" returned: 0 in 0.534s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:51 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b 1G Apr 16 14:41:51 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:51 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662" returned: 0 in 0.502s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:51 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662 Apr 16 14:41:51 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:51 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b 1G" returned: 0 in 0.465s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d026861-140f-4923-a6b1-2da8436fdfee -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:51 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d026861-140f-4923-a6b1-2da8436fdfee -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b Apr 16 14:41:51 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:51 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6df530c1-8610-4d68-8089-df1639343662" returned: 0 in 0.428s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Lock "cinder-quobyte-6df530c1-8610-4d68-8089-df1639343662" released by "delete_volume" :: held 0.952s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Created reservations ['f6a1b429-7f74-4f75-971f-50a244620860', 'a922a79e-a4bb-423d-85e6-70d5838a5b6e', '773fadcf-0d74-4f84-947b-b424299a8fa7', '3cec0070-ca00-4592-84a7-a889e2ce3efe'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:51 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:41:51 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:51 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d026861-140f-4923-a6b1-2da8436fdfee -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b" returned: 0 in 0.449s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:51 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b is being set with open permissions: ugo+rw Apr 16 14:41:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:51 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b Apr 16 14:41:51 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:52 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.444s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:52 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:41:52 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Deleted volume successfully. Apr 16 14:41:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c5d450fb-9d01-498b-bac9-3855b04a4c91 tempest-VolumesActionsTest-304941038 None] Lock "cinder-6df530c1-8610-4d68-8089-df1639343662-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:52 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b" returned: 0 in 0.436s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:52 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.info Apr 16 14:41:52 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:52 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.info" returned: 0 in 0.425s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:52 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.info is being set with open permissions: ugo+rw Apr 16 14:41:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:52 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.info Apr 16 14:41:52 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:53 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.info" returned: 0 in 0.490s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-quobyte-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] snapshot: e75c0cb1-db4c-44f7-b6e9-780ae26d518b, volume: eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a8b8e3-1b5b-41ed-a89a-4a89810dfda2]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:53 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b Apr 16 14:41:53 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:53 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b" returned: 0 in 0.524s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d026861-140f-4923-a6b1-2da8436fdfee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4071e0c5-f612-452d-937f-8af4391e8b16]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:53 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee Apr 16 14:41:53 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:54 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee" returned: 0 in 0.562s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:54 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:41:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:54 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac Apr 16 14:41:54 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:56 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac" returned: 0 in 2.154s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:56 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a6bfe5-ceef-44ad-b941-b4d9982b3366]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:56 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee Apr 16 14:41:56 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:57 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee" returned: 0 in 0.619s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:57 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:41:57 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Converted 1024.00 MB image at 474.94 MB/s Apr 16 14:41:57 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac is being set with open permissions: ugo+rw Apr 16 14:41:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:57 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac Apr 16 14:41:57 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:57 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac" returned: 0 in 0.429s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac" released by "_copy_volume_from_snapshot" :: held 4.343s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-quobyte-e75c0cb1-db4c-44f7-b6e9-780ae26d518b" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:41:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-e75c0cb1-db4c-44f7-b6e9-780ae26d518b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:41:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Deleting offline snapshot e75c0cb1-db4c-44f7-b6e9-780ae26d518b of volume 1d026861-140f-4923-a6b1-2da8436fdfee {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:41:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] snapshot_file for this snap is: volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:41:57 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c4867-a2a6-4bcd-b8e3-caa5925fa99e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:57 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b Apr 16 14:41:57 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:58 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b" returned: 0 in 0.519s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:58 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d026861-140f-4923-a6b1-2da8436fdfee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:41:58 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d6d22e-71a4-49e2-b17f-a40cf30523ec]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:41:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:58 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee Apr 16 14:41:58 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:58 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee" returned: 0 in 0.552s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:58 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b Apr 16 14:41:58 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:59 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b" returned: 0 in 0.510s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:59 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b Apr 16 14:41:59 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:59 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee.e75c0cb1-db4c-44f7-b6e9-780ae26d518b" returned: 0 in 0.461s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-e75c0cb1-db4c-44f7-b6e9-780ae26d518b" released by "_delete_snapshot" :: held 2.091s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.411s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.848s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-733796771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44843990-e20e-4611-9c1c-f30a67b3da0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8192eb97f7846098b1d958cd03b573a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:41:50Z,use_quota=True,user_id='4dd34d9c7488424d961dec09587ccfa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Creating volume 44843990-e20e-4611-9c1c-f30a67b3da0f {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:41:59 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a007261-c425-438d-ae31-05d1cf86c0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac', 'volume_size': 1, 'source_volid': '1d026861-140f-4923-a6b1-2da8436fdfee', 'source_volstatus': 'available'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:59 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f 1073741824 Apr 16 14:41:59 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb2f506-b887-4e89-aaa8-08e92d100226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:41:59 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Volume volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac (eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac): created successfully Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb2f506-b887-4e89-aaa8-08e92d100226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:41:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Flow 'volume_create_manager' (aa3ae280-c91e-43be-8a51-4bd37e10231f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:41:59 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-08dcf46f-f704-4012-a1b2-56624d7a1cc0 tempest-VolumeDependencyTests-1802724007 None] Created volume successfully. Apr 16 14:42:00 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f 1073741824" returned: 0 in 0.531s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:00 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f Apr 16 14:42:00 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-1d026861-140f-4923-a6b1-2da8436fdfee-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-1d026861-140f-4923-a6b1-2da8436fdfee-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-quobyte-1d026861-140f-4923-a6b1-2da8436fdfee" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-1d026861-140f-4923-a6b1-2da8436fdfee" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d428fb-471d-4ae4-8d98-67a8656d4984]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:00 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee Apr 16 14:42:00 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:00 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f" returned: 0 in 0.490s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.166s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac480b80-2430-4906-98ac-2af2262f56e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44843990-e20e-4611-9c1c-f30a67b3da0f', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909380e5-2eb5-4de3-af08-cbb4da92a1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] Creating offline snapshot 82702b48-968a-4653-ac7f-5141ef3e9476 of volume b63113e0-75ee-4e9c-a22a-1bff718316cd {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:42:00 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Volume volume-44843990-e20e-4611-9c1c-f30a67b3da0f (44843990-e20e-4611-9c1c-f30a67b3da0f): created successfully Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909380e5-2eb5-4de3-af08-cbb4da92a1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Flow 'volume_create_manager' (e3990c3a-06d8-463d-893d-7fd57ac734b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda67c96-7ffb-4e00-9572-e1c92eebf9ef]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:00 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-8918f38f-486a-4bb0-a746-570e1ca4478f tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Created volume successfully. Apr 16 14:42:01 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd Apr 16 14:42:01 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Flow 'volume_create_manager' (b8b1e093-c77e-44a6-94b5-e29bba31e2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98fd4e7-89a9-4856-ae3e-a34c1ac3a651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98fd4e7-89a9-4856-ae3e-a34c1ac3a651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1337360973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e78072-b91f-4ec7-96b2-51bd00dd7baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5603a01f2e347798ef5a38258aca738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:01Z,use_quota=True,user_id='12f1b389b13f45fe88e100eaab0038dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1773fb84-13a5-48b0-a471-df35edea5ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1773fb84-13a5-48b0-a471-df35edea5ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c14593e-af6e-4551-8b2a-3dbe3fb1c425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:01 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c14593e-af6e-4551-8b2a-3dbe3fb1c425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e78072-b91f-4ec7-96b2-51bd00dd7baf', 'volume_name': 'volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5372ba-4925-4208-8fde-5bad155adad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5372ba-4925-4208-8fde-5bad155adad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cba0ed-c414-49e6-aeaa-ba19c236233d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:01 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Volume a1e78072-b91f-4ec7-96b2-51bd00dd7baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf', 'volume_size': 1} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee" returned: 0 in 0.550s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:01 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee Apr 16 14:42:01 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:01 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd" returned: 0 in 0.535s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:01 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 1G Apr 16 14:42:01 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:01 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1d026861-140f-4923-a6b1-2da8436fdfee" returned: 0 in 0.438s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-1d026861-140f-4923-a6b1-2da8436fdfee" released by "delete_volume" :: held 1.016s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Created reservations ['4bccf6bc-4e4f-4d47-b090-8cb5a90b1286', 'f5c8d57a-e9cd-4759-ac11-5d3c0a065411', 'c31762e5-4ad6-4d64-a7ea-7c9b6a6b9cb6', '49c7569d-2fc6-4a61-afa1-2875df1be8a6'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:01 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:01 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:02 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 1G" returned: 0 in 0.594s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63113e0-75ee-4e9c-a22a-1bff718316cd -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:02 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63113e0-75ee-4e9c-a22a-1bff718316cd -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 Apr 16 14:42:02 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:02 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.449s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:02 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Deleted volume successfully. Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c17c22ec-5403-4fe1-b11d-162faff57cd0 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-1d026861-140f-4923-a6b1-2da8436fdfee-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Acquiring lock "cinder-44843990-e20e-4611-9c1c-f30a67b3da0f-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Lock "cinder-44843990-e20e-4611-9c1c-f30a67b3da0f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Acquiring lock "cinder-quobyte-44843990-e20e-4611-9c1c-f30a67b3da0f" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Lock "cinder-quobyte-44843990-e20e-4611-9c1c-f30a67b3da0f" acquired by "delete_volume" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83262791-eb13-4510-8b95-1e62ea2b1962]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:02 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f Apr 16 14:42:02 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:02 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63113e0-75ee-4e9c-a22a-1bff718316cd -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476" returned: 0 in 0.486s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:02 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 is being set with open permissions: ugo+rw Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:02 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 Apr 16 14:42:02 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-quobyte-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[376f0133-521a-4cf9-8034-2be952d16de7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:02 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f" returned: 0 in 0.524s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:02 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f Apr 16 14:42:02 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:02 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac Apr 16 14:42:02 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:02 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476" returned: 0 in 0.429s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:03 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.info Apr 16 14:42:03 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:03 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44843990-e20e-4611-9c1c-f30a67b3da0f" returned: 0 in 0.426s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Lock "cinder-quobyte-44843990-e20e-4611-9c1c-f30a67b3da0f" released by "delete_volume" :: held 0.974s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:03 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac" returned: 0 in 0.507s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Created reservations ['953fb253-23a8-4753-8c9f-6160bc04901b', 'b47f63a0-641f-459d-a0b6-ca820cf82350', '21fcc48b-663b-40b3-a4e1-502b0f99b113', '5752118a-2521-43b7-a84a-d48358142cde'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:03 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac Apr 16 14:42:03 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:03 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:03 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:03 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.info" returned: 0 in 0.440s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:03 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.info is being set with open permissions: ugo+rw Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:03 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.info Apr 16 14:42:03 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:03 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac" returned: 0 in 0.426s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac" released by "delete_volume" :: held 0.958s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Created reservations ['eaf4ecbe-18fa-4c51-a696-50774adba288', 'f9eb833f-37d1-42c3-a47c-a9ec8d7180fd', '8c8b8472-06a3-4407-85b6-8f7b51233f7a', '7ae95e02-7f75-4731-92ea-dfc1fa1803f6'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:03 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.408s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:03 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Deleted volume successfully. Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c2b7bb10-bfde-4856-99ab-9c3448fc00be tempest-VolumeQuotasNegativeTestJSON-1518875464 None] Lock "cinder-44843990-e20e-4611-9c1c-f30a67b3da0f-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:03 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:03 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:03 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.info" returned: 0 in 0.441s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.726s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1337360973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e78072-b91f-4ec7-96b2-51bd00dd7baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5603a01f2e347798ef5a38258aca738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:01Z,use_quota=True,user_id='12f1b389b13f45fe88e100eaab0038dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Creating volume a1e78072-b91f-4ec7-96b2-51bd00dd7baf {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:03 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-47763017-a8bc-482d-84d4-d5f9c5fcb04e-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:03 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf 1073741824 Apr 16 14:42:03 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-47763017-a8bc-482d-84d4-d5f9c5fcb04e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:03 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-8d106d0c-ee2d-42b1-9941-ad08a4722d1a tempest-SnapshotDependencyTests-635596744 None] Create snapshot completed successfully Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "cinder-quobyte-47763017-a8bc-482d-84d4-d5f9c5fcb04e" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-47763017-a8bc-482d-84d4-d5f9c5fcb04e" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b4aa6f-1a92-4bc9-bde9-0d671cf8414b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:04 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e Apr 16 14:42:04 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:04 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.510s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:04 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Deleted volume successfully. Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a859b5d-3293-427c-8481-eee6235e5754 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-eab21c1a-5ae3-4a37-9ea9-a2af6f89ecac-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:04 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf 1073741824" returned: 0 in 0.586s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:04 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e" returned: 0 in 0.556s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:04 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf Apr 16 14:42:04 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:04 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e Apr 16 14:42:04 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Flow 'volume_create_manager' (7243d468-6a80-4cae-b109-3c4de5cb7fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a612be5a-e43c-4aab-82a9-c421a440f38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a612be5a-e43c-4aab-82a9-c421a440f38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47626e79-61d0-4a77-b08a-0b71ee1a877a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eaab53687a0416d89fb2cdd3b4916c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82702b48-968a-4653-ac7f-5141ef3e9476,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:05Z,use_quota=True,user_id='09c62bb2a4ed4c5d8535a7a4055856ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ee755f-00ee-45a0-a51b-be76c534d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ee755f-00ee-45a0-a51b-be76c534d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77d54d3-80db-433e-a923-3d0c4dfdba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77d54d3-80db-433e-a923-3d0c4dfdba53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47626e79-61d0-4a77-b08a-0b71ee1a877a', 'volume_name': 'volume-47626e79-61d0-4a77-b08a-0b71ee1a877a', 'volume_size': 1, 'snapshot_id': '82702b48-968a-4653-ac7f-5141ef3e9476'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ba0e3a-3540-4748-aaf8-75c0a3980cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ba0e3a-3540-4748-aaf8-75c0a3980cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8511237-4367-4323-be4e-622fb08dbd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:04 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Volume 47626e79-61d0-4a77-b08a-0b71ee1a877a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47626e79-61d0-4a77-b08a-0b71ee1a877a', 'volume_size': 1, 'snapshot_id': '82702b48-968a-4653-ac7f-5141ef3e9476'} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:04 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47763017-a8bc-482d-84d4-d5f9c5fcb04e" returned: 0 in 0.440s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-quobyte-47763017-a8bc-482d-84d4-d5f9c5fcb04e" released by "delete_volume" :: held 1.017s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:04 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf" returned: 0 in 0.485s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.353s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:04 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "cinder-quobyte-82702b48-968a-4653-ac7f-5141ef3e9476-47626e79-61d0-4a77-b08a-0b71ee1a877a" by "_create_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-82702b48-968a-4653-ac7f-5141ef3e9476-47626e79-61d0-4a77-b08a-0b71ee1a877a" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Creating volume 47626e79-61d0-4a77-b08a-0b71ee1a877a from snapshot 82702b48-968a-4653-ac7f-5141ef3e9476 {{(pid=83305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "cinder-quobyte-47626e79-61d0-4a77-b08a-0b71ee1a877a" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cba0ed-c414-49e6-aeaa-ba19c236233d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9244ff5-4c2d-4c30-a2f5-69341240c10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:05 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Volume volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf (a1e78072-b91f-4ec7-96b2-51bd00dd7baf): created successfully Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9244ff5-4c2d-4c30-a2f5-69341240c10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Flow 'volume_create_manager' (b8b1e093-c77e-44a6-94b5-e29bba31e2df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-47626e79-61d0-4a77-b08a-0b71ee1a877a" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] snapshot: 82702b48-968a-4653-ac7f-5141ef3e9476, volume: 47626e79-61d0-4a77-b08a-0b71ee1a877a, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:05 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a04cc473-fad6-4d47-ae97-4f5a5c322532 tempest-VolumesTransfersV355Test-1574121136 None] Created volume successfully. Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4270f877-f855-47e0-86b1-272d9357b1e1]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Created reservations ['c6065d84-f406-4e6b-8e9b-824a4cc6d1bd', '2e541676-4725-4447-aae3-7b5c2ed74fd7', 'd175bd4c-b5e3-405e-afd7-575cca14d02d', 'a872f0f6-98ef-49e8-b921-94bfd5dd5ecb'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:05 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:05 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 Apr 16 14:42:05 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:05 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:05 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.533s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:05 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Deleted volume successfully. Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5f733a5a-2d57-48df-b87d-df52d6e152f6 tempest-VolumeDependencyTests-1802724007 None] Lock "cinder-47763017-a8bc-482d-84d4-d5f9c5fcb04e-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:05 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476" returned: 0 in 0.666s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b63113e0-75ee-4e9c-a22a-1bff718316cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc422548-de9b-4638-b2a0-84e4898d2caf]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:05 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-83ea618f-5ef8-4155-bc48-072907dee75e tempest-VolumesTransfersV355Test-736553131 None] Transfer volume completed successfully. Apr 16 14:42:05 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd Apr 16 14:42:05 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:06 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd" returned: 0 in 0.529s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:06 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:42:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:06 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a Apr 16 14:42:06 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Acquiring lock "cinder-a1e78072-b91f-4ec7-96b2-51bd00dd7baf-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Lock "cinder-a1e78072-b91f-4ec7-96b2-51bd00dd7baf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Acquiring lock "cinder-quobyte-a1e78072-b91f-4ec7-96b2-51bd00dd7baf" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:06 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Lock "cinder-quobyte-a1e78072-b91f-4ec7-96b2-51bd00dd7baf" acquired by "delete_volume" :: waited 0.033s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:06 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde27e81-7f27-44ed-b439-e6a9b46e5ad5]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:07 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf Apr 16 14:42:07 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:08 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf" returned: 0 in 1.775s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:08 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf Apr 16 14:42:08 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:08 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a" returned: 0 in 2.536s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:08 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b20d522-9b87-4fe5-aa55-afea62658054]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:08 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd Apr 16 14:42:08 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:09 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a1e78072-b91f-4ec7-96b2-51bd00dd7baf" returned: 0 in 0.452s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Lock "cinder-quobyte-a1e78072-b91f-4ec7-96b2-51bd00dd7baf" released by "delete_volume" :: held 2.290s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Created reservations ['7e8c48d7-21a9-46d6-8275-1a7637b5a396', '8a22aa86-6899-4107-9c4a-70d06f47f550', '40467c3f-228a-49e3-935d-1653ba4498fe', '0b251b00-9cf8-4d42-837e-ee73eadd9d78'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Flow 'volume_create_manager' (cc666abb-06fa-438f-aca9-55b04c0d6f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9fb624-47ca-4c90-9bb5-9677c0bf6006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9fb624-47ca-4c90-9bb5-9677c0bf6006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1385644513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3e9dd8-9efb-4900-8032-60caa0db01b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0d1b9484b84f089aaccc5518aa2421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:09Z,use_quota=True,user_id='702378957ecf42a9b8f6f45522a3aa24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6457cef2-5fe8-41eb-9eaa-75f0815da1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6457cef2-5fe8-41eb-9eaa-75f0815da1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574d0a67-d1ed-4cc7-b01c-ba656fe31f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574d0a67-d1ed-4cc7-b01c-ba656fe31f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce3e9dd8-9efb-4900-8032-60caa0db01b5', 'volume_name': 'volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e98e1e-7eec-4a01-94de-47aba7b42391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e98e1e-7eec-4a01-94de-47aba7b42391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8553e6d6-991b-407f-ba4c-d383b1aec60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:09 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Volume ce3e9dd8-9efb-4900-8032-60caa0db01b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5', 'volume_size': 1} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:09 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:09 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:09 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd" returned: 0 in 0.667s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd, size 1024.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:42:09 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Converted 1024.00 MB image at 403.61 MB/s Apr 16 14:42:09 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a is being set with open permissions: ugo+rw Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:09 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a Apr 16 14:42:09 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:09 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.405s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:09 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Deleted volume successfully. Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-09c72fcb-9271-4cbf-87a2-14a4f47c9576 tempest-VolumesTransfersV355Test-38522864 None] Lock "cinder-a1e78072-b91f-4ec7-96b2-51bd00dd7baf-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:09 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a" returned: 0 in 0.430s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-47626e79-61d0-4a77-b08a-0b71ee1a877a" released by "_copy_volume_from_snapshot" :: held 4.894s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-82702b48-968a-4653-ac7f-5141ef3e9476-47626e79-61d0-4a77-b08a-0b71ee1a877a" released by "_create_volume_from_snapshot" :: held 4.936s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.947s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.572s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1385644513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3e9dd8-9efb-4900-8032-60caa0db01b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0d1b9484b84f089aaccc5518aa2421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:09Z,use_quota=True,user_id='702378957ecf42a9b8f6f45522a3aa24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Creating volume ce3e9dd8-9efb-4900-8032-60caa0db01b5 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:09 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:09 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 1073741824 Apr 16 14:42:09 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8511237-4367-4323-be4e-622fb08dbd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47626e79-61d0-4a77-b08a-0b71ee1a877a', 'volume_size': 1, 'snapshot_id': '82702b48-968a-4653-ac7f-5141ef3e9476'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708d5081-47e4-4cb7-8278-6272fd88bba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:09 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Volume volume-47626e79-61d0-4a77-b08a-0b71ee1a877a (47626e79-61d0-4a77-b08a-0b71ee1a877a): created successfully Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708d5081-47e4-4cb7-8278-6272fd88bba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Flow 'volume_create_manager' (7243d468-6a80-4cae-b109-3c4de5cb7fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:10 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-76605b0b-c789-4d57-9ebc-5160a341a720 tempest-SnapshotDependencyTests-635596744 None] Created volume successfully. Apr 16 14:42:10 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 1073741824" returned: 0 in 0.509s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:10 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 Apr 16 14:42:10 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Flow 'volume_create_manager' (46c1b33e-cc8c-43d2-84c6-fed53ee76580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b82d522-a1db-450d-9db8-8ff98b35eba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b82d522-a1db-450d-9db8-8ff98b35eba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-605849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33b627e-d60d-4e56-bdd4-c617a5a8b9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5603a01f2e347798ef5a38258aca738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:10Z,use_quota=True,user_id='12f1b389b13f45fe88e100eaab0038dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13f6991-9815-49c8-803e-d8017c1c7963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13f6991-9815-49c8-803e-d8017c1c7963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075fe1bb-bbdd-4dc2-bc6c-fc50e910d21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075fe1bb-bbdd-4dc2-bc6c-fc50e910d21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd33b627e-d60d-4e56-bdd4-c617a5a8b9f3', 'volume_name': 'volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e246659-82a6-41ce-9315-ebfdd1e627f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e246659-82a6-41ce-9315-ebfdd1e627f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1658d24-e164-43f8-b0b8-132dbf87f3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:10 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Volume d33b627e-d60d-4e56-bdd4-c617a5a8b9f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3', 'volume_size': 1} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:10 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5" returned: 0 in 0.411s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-605849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33b627e-d60d-4e56-bdd4-c617a5a8b9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5603a01f2e347798ef5a38258aca738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:10Z,use_quota=True,user_id='12f1b389b13f45fe88e100eaab0038dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Creating volume d33b627e-d60d-4e56-bdd4-c617a5a8b9f3 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:10 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:10 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3 1073741824 Apr 16 14:42:10 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8553e6d6-991b-407f-ba4c-d383b1aec60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70abbe3c-a105-4f8a-9af4-3c860cd1ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:10 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Volume volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 (ce3e9dd8-9efb-4900-8032-60caa0db01b5): created successfully Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70abbe3c-a105-4f8a-9af4-3c860cd1ae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Flow 'volume_create_manager' (cc666abb-06fa-438f-aca9-55b04c0d6f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:10 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-80d229da-5ab3-42f1-a92e-c2d404b33f70 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Created volume successfully. Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "cinder-82702b48-968a-4653-ac7f-5141ef3e9476-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-82702b48-968a-4653-ac7f-5141ef3e9476-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "cinder-quobyte-b63113e0-75ee-4e9c-a22a-1bff718316cd" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-b63113e0-75ee-4e9c-a22a-1bff718316cd" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "cinder-quobyte-82702b48-968a-4653-ac7f-5141ef3e9476" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-82702b48-968a-4653-ac7f-5141ef3e9476" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Deleting offline snapshot 82702b48-968a-4653-ac7f-5141ef3e9476 of volume b63113e0-75ee-4e9c-a22a-1bff718316cd {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] snapshot_file for this snap is: volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a8f083-7352-4e90-8e27-cb77bc3fb306]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:11 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 Apr 16 14:42:11 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:11 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3 1073741824" returned: 0 in 0.556s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:11 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3 Apr 16 14:42:11 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:11 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476" returned: 0 in 0.566s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b63113e0-75ee-4e9c-a22a-1bff718316cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbb18c6-0d99-44c2-9464-cea96cd7ee76]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:11 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd Apr 16 14:42:11 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:11 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3" returned: 0 in 0.445s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.381s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=158,cinder:UPDATE=223,cinder:DELETE=17,cinder:INSERT=59 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Creating offline snapshot 96236c8f-bc32-4da8-b9c9-1eda287ea818 of volume ce3e9dd8-9efb-4900-8032-60caa0db01b5 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1658d24-e164-43f8-b0b8-132dbf87f3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a35b99-275a-4cd4-bec4-cffb925b8098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4d98f6-5bd0-412a-a3d0-bbe9143a2da7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:11 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Volume volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3 (d33b627e-d60d-4e56-bdd4-c617a5a8b9f3): created successfully Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a35b99-275a-4cd4-bec4-cffb925b8098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Flow 'volume_create_manager' (46c1b33e-cc8c-43d2-84c6-fed53ee76580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:11 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-15ce0ddd-26f2-446f-8d2f-cd9e45515769 tempest-VolumesTransfersV355Test-1574121136 None] Created volume successfully. Apr 16 14:42:12 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 Apr 16 14:42:12 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:12 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd" returned: 0 in 0.479s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:12 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 Apr 16 14:42:12 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:12 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5" returned: 0 in 0.492s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:12 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 1G Apr 16 14:42:12 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:12 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476" returned: 0 in 0.516s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:12 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476 Apr 16 14:42:12 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Acquiring lock "cinder-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Lock "cinder-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=186,cinder:UPDATE=247,cinder:DELETE=22,cinder:INSERT=51 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Acquiring lock "cinder-quobyte-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Lock "cinder-quobyte-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8e5822-09cf-4360-b628-b78f3c2677b3]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:12 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3 Apr 16 14:42:12 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:12 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 1G" returned: 0 in 0.543s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:13 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 Apr 16 14:42:13 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:13 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd.82702b48-968a-4653-ac7f-5141ef3e9476" returned: 0 in 0.461s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-82702b48-968a-4653-ac7f-5141ef3e9476" released by "_delete_snapshot" :: held 2.085s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-b63113e0-75ee-4e9c-a22a-1bff718316cd" released by "delete_snapshot" :: held 2.102s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Created reservations ['41445b66-5295-4730-91ff-d09d47983a8c', '29cbc14e-a883-4400-9083-3b6c08ae343e', 'e7570407-47f9-4b5b-b6ee-0601fdfce607', 'fc1ac7d8-b2f9-45a0-9d21-d332994eac4a'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:13 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Delete snapshot completed successfully. Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-c474829d-5f90-47c0-8b9d-d80cb5c3e233 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-82702b48-968a-4653-ac7f-5141ef3e9476-delete_snapshot" released by "delete_snapshot" :: held 2.182s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:13 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3" returned: 0 in 0.513s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:13 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3 Apr 16 14:42:13 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:13 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818" returned: 0 in 0.452s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:13 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 is being set with open permissions: ugo+rw Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:13 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 Apr 16 14:42:13 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:13 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3" returned: 0 in 0.404s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Lock "cinder-quobyte-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3" released by "delete_volume" :: held 0.941s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Created reservations ['5b429f3f-aa4c-4489-9b9f-c6b47e3e1d68', '3aeb9db1-9ead-4df5-9975-4285fd196b72', '238c241c-e7ac-4bda-836f-a922c4336436', '8e903a86-97c1-41e1-b111-bd6c858476d8'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:13 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818" returned: 0 in 0.450s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:13 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:13 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:13 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.info Apr 16 14:42:13 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "cinder-b63113e0-75ee-4e9c-a22a-1bff718316cd-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-b63113e0-75ee-4e9c-a22a-1bff718316cd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "cinder-quobyte-b63113e0-75ee-4e9c-a22a-1bff718316cd" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-b63113e0-75ee-4e9c-a22a-1bff718316cd" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7339e3c-549b-4f42-88b4-3c8f78dbc0cc]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:14 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd Apr 16 14:42:14 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:14 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.512s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:14 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Deleted volume successfully. Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e8e91a20-0b1c-4a03-ac87-20347fc2031b tempest-VolumesTransfersV355Test-38522864 None] Lock "cinder-d33b627e-d60d-4e56-bdd4-c617a5a8b9f3-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:14 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.info" returned: 0 in 0.501s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:14 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.info is being set with open permissions: ugo+rw Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:14 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.info Apr 16 14:42:14 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:14 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd" returned: 0 in 0.595s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:14 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:14 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd Apr 16 14:42:14 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.info" returned: 0 in 0.467s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.989s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:14 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-07225d6a-8f3e-492c-81c9-5e539506225c tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Create snapshot completed successfully Apr 16 14:42:15 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b63113e0-75ee-4e9c-a22a-1bff718316cd" returned: 0 in 0.506s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-b63113e0-75ee-4e9c-a22a-1bff718316cd" released by "delete_volume" :: held 1.147s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Created reservations ['9e8fedd3-6ec3-41eb-8a26-a23acf7e1b95', 'bbc1f7c7-ff28-4c71-a516-a313475b8a32', '2ad9c91f-bc9f-49a3-9411-409d772531e4', 'd3857649-4d8d-4911-947d-74b443abfda2'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:15 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:15 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Acquiring lock "cinder-96236c8f-bc32-4da8-b9c9-1eda287ea818-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "cinder-96236c8f-bc32-4da8-b9c9-1eda287ea818-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Acquiring lock "cinder-quobyte-ce3e9dd8-9efb-4900-8032-60caa0db01b5" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "cinder-quobyte-ce3e9dd8-9efb-4900-8032-60caa0db01b5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Acquiring lock "cinder-quobyte-96236c8f-bc32-4da8-b9c9-1eda287ea818" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "cinder-quobyte-96236c8f-bc32-4da8-b9c9-1eda287ea818" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Deleting offline snapshot 96236c8f-bc32-4da8-b9c9-1eda287ea818 of volume ce3e9dd8-9efb-4900-8032-60caa0db01b5 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] snapshot_file for this snap is: volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f91791-bdc8-427e-a593-49d6cd96ce3e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:16 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.577s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:16 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Deleted volume successfully. Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-170bfbdb-99c8-45c1-af4b-c5db61dbf673 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-b63113e0-75ee-4e9c-a22a-1bff718316cd-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:16 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 Apr 16 14:42:16 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "cinder-47626e79-61d0-4a77-b08a-0b71ee1a877a-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-47626e79-61d0-4a77-b08a-0b71ee1a877a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "cinder-quobyte-47626e79-61d0-4a77-b08a-0b71ee1a877a" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-47626e79-61d0-4a77-b08a-0b71ee1a877a" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e71eaec-f5e3-4cca-b92c-4213beaabb3e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:16 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a Apr 16 14:42:16 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:16 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818" returned: 0 in 0.591s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86098b36-5ccc-4813-b813-86f5641c8400]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:16 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 Apr 16 14:42:16 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:16 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a" returned: 0 in 0.511s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:16 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a Apr 16 14:42:16 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:17 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5" returned: 0 in 0.550s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:17 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 Apr 16 14:42:17 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:17 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-47626e79-61d0-4a77-b08a-0b71ee1a877a" returned: 0 in 0.534s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-quobyte-47626e79-61d0-4a77-b08a-0b71ee1a877a" released by "delete_volume" :: held 1.087s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Created reservations ['c629b3b5-d790-4997-a940-a2c1609a20b9', 'bdf4cd65-e5fe-49e1-86c7-917129801696', '7ff05bec-7adb-4c8d-96e2-156b2ed1c51f', '542c37d3-d427-4b36-9fa2-e78c3beced80'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:17 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:17 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:17 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818" returned: 0 in 0.536s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:17 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818 Apr 16 14:42:17 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:18 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.453s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:18 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Deleted volume successfully. Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a8f6c397-d76d-4926-95fa-85c47c2b7332 tempest-SnapshotDependencyTests-635596744 None] Lock "cinder-47626e79-61d0-4a77-b08a-0b71ee1a877a-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:18 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5.96236c8f-bc32-4da8-b9c9-1eda287ea818" returned: 0 in 0.441s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "cinder-quobyte-96236c8f-bc32-4da8-b9c9-1eda287ea818" released by "_delete_snapshot" :: held 2.177s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "cinder-quobyte-ce3e9dd8-9efb-4900-8032-60caa0db01b5" released by "delete_snapshot" :: held 2.190s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Created reservations ['6ccc6631-1f10-4823-8967-fe17514881e6', '6e7df315-1282-4a78-9eeb-e14bb93a9c5c', '6900823c-2d62-443f-b2eb-bfa9701df563', 'dbf2c331-c648-40db-ba6a-1dcd943e6b22'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:18 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Delete snapshot completed successfully. Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5d8b2006-8793-44a1-8c4e-a2384d05c927 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "cinder-96236c8f-bc32-4da8-b9c9-1eda287ea818-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Flow 'volume_create_manager' (1c8f637d-8dca-4270-b20f-fdd28eaa9c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae45657-50bd-4f17-a14a-8730327a78a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae45657-50bd-4f17-a14a-8730327a78a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1574125664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f01b85-f174-4118-b2fb-3c9e5a11e5fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f5c784dc564201b8b70a62a0745929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:18Z,use_quota=True,user_id='8912b6694e344c06800780744fd0f1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1994b616-2035-4873-afa1-3c347b406ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1994b616-2035-4873-afa1-3c347b406ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7fb6a2-ac5e-4643-8fbd-4b8745780699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7fb6a2-ac5e-4643-8fbd-4b8745780699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f01b85-f174-4118-b2fb-3c9e5a11e5fa', 'volume_name': 'volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c418a4-a606-4585-ad97-0d5fc8e3b568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c418a4-a606-4585-ad97-0d5fc8e3b568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b15164c-515c-41de-adec-ff495b7786c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:18 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Volume 19f01b85-f174-4118-b2fb-3c9e5a11e5fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa', 'volume_size': 1} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1574125664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f01b85-f174-4118-b2fb-3c9e5a11e5fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f5c784dc564201b8b70a62a0745929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:18Z,use_quota=True,user_id='8912b6694e344c06800780744fd0f1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Creating volume 19f01b85-f174-4118-b2fb-3c9e5a11e5fa {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:18 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:18 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa 1073741824 Apr 16 14:42:18 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:18 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa 1073741824" returned: 0 in 0.500s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:18 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa Apr 16 14:42:18 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:19 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa" returned: 0 in 0.469s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b15164c-515c-41de-adec-ff495b7786c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35dae30b-7ec7-4ac4-a036-0c5c63675bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:19 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Volume volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa (19f01b85-f174-4118-b2fb-3c9e5a11e5fa): created successfully Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35dae30b-7ec7-4ac4-a036-0c5c63675bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Flow 'volume_create_manager' (1c8f637d-8dca-4270-b20f-fdd28eaa9c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Acquiring lock "cinder-ce3e9dd8-9efb-4900-8032-60caa0db01b5-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:19 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5a583efb-19d9-452e-a527-ee624210ceb1 tempest-VolumesTransfersV357Test-1513659765 None] Created volume successfully. Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "cinder-ce3e9dd8-9efb-4900-8032-60caa0db01b5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Acquiring lock "cinder-quobyte-ce3e9dd8-9efb-4900-8032-60caa0db01b5" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "cinder-quobyte-ce3e9dd8-9efb-4900-8032-60caa0db01b5" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d3730c-a80e-473a-aea1-3fbac809d009]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:19 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 Apr 16 14:42:19 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:19 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5" returned: 0 in 0.509s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:20 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5 Apr 16 14:42:20 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:20 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ce3e9dd8-9efb-4900-8032-60caa0db01b5" returned: 0 in 0.444s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "cinder-quobyte-ce3e9dd8-9efb-4900-8032-60caa0db01b5" released by "delete_volume" :: held 0.982s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:20 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Created reservations ['97d47f81-e169-43d5-b610-61805441038c', '81fb5b78-0a84-4c36-89ad-96a531c64e16', 'f05c0c86-331b-44a8-b5e7-8dd5c7ffd48d', 'c585e348-60e6-4306-bf8d-ccd479a01cbf'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:20 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:20 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:20 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-63cc642a-7d60-4986-957b-77eff7200d96 tempest-VolumesTransfersV357Test-1689445249 None] Transfer volume completed successfully. Apr 16 14:42:21 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.451s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:21 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:21 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Deleted volume successfully. Apr 16 14:42:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0a0ecf99-52d9-4912-b217-c6449051ad25 tempest-VolumeSnapshotQuotasNegativeTestJSON-2091361 None] Lock "cinder-ce3e9dd8-9efb-4900-8032-60caa0db01b5-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Acquiring lock "cinder-19f01b85-f174-4118-b2fb-3c9e5a11e5fa-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Lock "cinder-19f01b85-f174-4118-b2fb-3c9e5a11e5fa-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Acquiring lock "cinder-quobyte-19f01b85-f174-4118-b2fb-3c9e5a11e5fa" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Lock "cinder-quobyte-19f01b85-f174-4118-b2fb-3c9e5a11e5fa" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:21 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa666f1a-edae-4b95-a171-7ce7a4cdfbef]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:21 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa Apr 16 14:42:21 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:22 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa" returned: 0 in 0.558s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:22 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa Apr 16 14:42:22 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:22 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-19f01b85-f174-4118-b2fb-3c9e5a11e5fa" returned: 0 in 0.487s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:22 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Lock "cinder-quobyte-19f01b85-f174-4118-b2fb-3c9e5a11e5fa" released by "delete_volume" :: held 1.076s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:22 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Created reservations ['9b17d12b-33a3-4564-8040-a2bea1add1b0', 'dbdba9f0-5486-4193-907d-89befeae0cd5', 'e63fb52a-df22-42ae-acf9-b4e48ab0f5d2', '13cda1e9-649d-4f9a-8bae-a2caa788c26b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:22 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:22 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:22 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:22 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:23 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.560s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:23 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:23 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Deleted volume successfully. Apr 16 14:42:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-16b4c3b4-f66e-49f6-8367-fc001f7c7e60 tempest-VolumesTransfersV357Test-621104558 None] Lock "cinder-19f01b85-f174-4118-b2fb-3c9e5a11e5fa-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Flow 'volume_create_manager' (9b17a00d-0fbe-4c49-bc8a-1188dc619c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662c1883-603e-48c9-b83d-cef6b62acf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662c1883-603e-48c9-b83d-cef6b62acf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-81360538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5bddc4c-d324-42b6-94cf-d06eb03b122b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f5c784dc564201b8b70a62a0745929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:24Z,use_quota=True,user_id='8912b6694e344c06800780744fd0f1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a94d905-34ef-4e3c-8bdc-6e9b0c344add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a94d905-34ef-4e3c-8bdc-6e9b0c344add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf44a77-7c6d-4a22-9972-b593b5c6aafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf44a77-7c6d-4a22-9972-b593b5c6aafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5bddc4c-d324-42b6-94cf-d06eb03b122b', 'volume_name': 'volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed472331-461e-4779-ab4a-1fe55a5b0b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed472331-461e-4779-ab4a-1fe55a5b0b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60c1cde-b26d-4d9e-97d4-36306229a032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:24 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Volume d5bddc4c-d324-42b6-94cf-d06eb03b122b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b', 'volume_size': 1} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-81360538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5bddc4c-d324-42b6-94cf-d06eb03b122b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f5c784dc564201b8b70a62a0745929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:24Z,use_quota=True,user_id='8912b6694e344c06800780744fd0f1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Creating volume d5bddc4c-d324-42b6-94cf-d06eb03b122b {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:24 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:24 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b 1073741824 Apr 16 14:42:24 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:24 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b 1073741824" returned: 0 in 0.572s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:25 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b Apr 16 14:42:25 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:25 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b" returned: 0 in 0.500s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:42:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60c1cde-b26d-4d9e-97d4-36306229a032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e44643-693f-42f1-870c-f6331f197833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:25 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Volume volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b (d5bddc4c-d324-42b6-94cf-d06eb03b122b): created successfully Apr 16 14:42:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e44643-693f-42f1-870c-f6331f197833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Flow 'volume_create_manager' (9b17a00d-0fbe-4c49-bc8a-1188dc619c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:25 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-51b115f0-bb6c-45d2-9aa9-7fb3aa284780 tempest-VolumesTransfersV357Test-1513659765 None] Created volume successfully. Apr 16 14:42:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Acquiring lock "cinder-d5bddc4c-d324-42b6-94cf-d06eb03b122b-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Lock "cinder-d5bddc4c-d324-42b6-94cf-d06eb03b122b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Acquiring lock "cinder-quobyte-d5bddc4c-d324-42b6-94cf-d06eb03b122b" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Lock "cinder-quobyte-d5bddc4c-d324-42b6-94cf-d06eb03b122b" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:26 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[63576ad0-fca1-45d8-b1c3-f9987bb01c24]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:26 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b Apr 16 14:42:26 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:27 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b" returned: 0 in 0.490s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:27 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b Apr 16 14:42:27 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:27 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d5bddc4c-d324-42b6-94cf-d06eb03b122b" returned: 0 in 0.449s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Lock "cinder-quobyte-d5bddc4c-d324-42b6-94cf-d06eb03b122b" released by "delete_volume" :: held 0.967s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:27 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Created reservations ['1406d50c-deb3-46e9-bfeb-d50fb82c60a7', '4651892c-0777-43d0-bbc0-cf74c6283335', '34fad5cc-dc74-45c8-a7d7-37ae25566ca1', 'f7d87c9e-a4c3-45e0-922f-66df68b98a3e'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:27 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:27 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:28 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.428s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:28 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:28 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Deleted volume successfully. Apr 16 14:42:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-fa1842b2-86f8-4a5c-b0f0-3bb088f81801 tempest-VolumesTransfersV357Test-621104558 None] Lock "cinder-d5bddc4c-d324-42b6-94cf-d06eb03b122b-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:32 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Flow 'volume_create_manager' (fefae34f-eab0-4fa4-8cd1-50ff501f01f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cfdf9d-a247-4cd1-9050-578dee36c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cfdf9d-a247-4cd1-9050-578dee36c98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-459440083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6565d192-49e3-4055-8729-cec34ed0f146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cfe55efa46c49e3a96dca26a7892f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:33Z,use_quota=True,user_id='2ba7c523b97b424b9667255174a55d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3f5639-baef-4901-89fb-6e415763a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3f5639-baef-4901-89fb-6e415763a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fda6cd-803f-4cde-b4eb-cfbb98babbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:32 devstack cinder-volume[83305]: DEBUG cinder.image.glance [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Creating Keystone auth plugin from conf {{(pid=83305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fda6cd-803f-4cde-b4eb-cfbb98babbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6565d192-49e3-4055-8729-cec34ed0f146', 'volume_name': 'volume-6565d192-49e3-4055-8729-cec34ed0f146', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec63309c-7ed6-436a-828b-4378263adc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec63309c-7ed6-436a-828b-4378263adc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afd5c08-849b-49bf-be20-bfd23d51a958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:33 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Volume 6565d192-49e3-4055-8729-cec34ed0f146: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6565d192-49e3-4055-8729-cec34ed0f146', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Trying to clone 6565d192-49e3-4055-8729-cec34ed0f146 from image a03b4007-0186-44e1-a560-91d8e58559a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]). {{(pid=83305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 14:42:33 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Image download 20.69 MB at 20.69 MB/s Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4249d3-8677-47f6-abf7-c473b23993b9]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:33 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD Apr 16 14:42:33 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:33 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Temporary image a03b4007-0186-44e1-a560-91d8e58559a1 is fetched for user 2ba7c523b97b424b9667255174a55d8c. {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0761c693-05a9-4ff8-8897-d7834ee500d6]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:33 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD Apr 16 14:42:33 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:34 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-459440083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6565d192-49e3-4055-8729-cec34ed0f146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cfe55efa46c49e3a96dca26a7892f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:33Z,use_quota=True,user_id='2ba7c523b97b424b9667255174a55d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Creating volume 6565d192-49e3-4055-8729-cec34ed0f146 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:34 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:34 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 1073741824 Apr 16 14:42:34 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:34 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 1073741824" returned: 0 in 0.488s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:34 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 Apr 16 14:42:34 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:35 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146" returned: 0 in 0.416s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:35 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:42:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:35 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Attempting download of a03b4007-0186-44e1-a560-91d8e58559a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}])) to volume 6565d192-49e3-4055-8729-cec34ed0f146. {{(pid=83305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 14:42:35 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2b1863-ff12-4d02-a3cb-17fc142ae93e]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_dged7gl3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:35 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_dged7gl3 Apr 16 14:42:35 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:35 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_dged7gl3" returned: 0 in 0.514s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_dged7gl3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:35 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_dged7gl3 Apr 16 14:42:35 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:36 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_dged7gl3" returned: 1 in 0.507s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_dged7gl3' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:42:36 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e312fddc-f0ae-440d-98a5-ea7a42409c60]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:36 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD Apr 16 14:42:36 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:36 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:36 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] a03b4007-0186-44e1-a560-91d8e58559a1 was qcow2, converting to raw {{(pid=83305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 14:42:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:36 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 Apr 16 14:42:36 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:37 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146" returned: 0 in 0.998s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:37 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_a8vavrukdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:42:37 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Converted 112.00 MB image at 111.99 MB/s Apr 16 14:42:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:37 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 1G Apr 16 14:42:37 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Flow 'volume_create_manager' (86716ad1-ab25-44d7-b049-86b45bfc1c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bca5c0-4aa0-4db9-84ff-077e46a01b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bca5c0-4aa0-4db9-84ff-077e46a01b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1318025594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97645559-dae2-4116-8269-68c2c182b069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c7f9c7194f469e9d4e01447f751db8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:38Z,use_quota=True,user_id='45a9c52518b743728b733ecf986c5a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97a4093-5375-4b3c-a2bc-c39664e87c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97a4093-5375-4b3c-a2bc-c39664e87c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a51531c-c85f-49bf-ad5b-6329d10a877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a51531c-c85f-49bf-ad5b-6329d10a877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97645559-dae2-4116-8269-68c2c182b069', 'volume_name': 'volume-97645559-dae2-4116-8269-68c2c182b069', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6695da1e-c26b-47e2-8bff-0c87ab15a257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6695da1e-c26b-47e2-8bff-0c87ab15a257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbe1f70-32f6-44d6-bc3f-1acf6ca0abba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:38 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Volume 97645559-dae2-4116-8269-68c2c182b069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97645559-dae2-4116-8269-68c2c182b069', 'volume_size': 1} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1318025594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97645559-dae2-4116-8269-68c2c182b069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c7f9c7194f469e9d4e01447f751db8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:38Z,use_quota=True,user_id='45a9c52518b743728b733ecf986c5a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Creating volume 97645559-dae2-4116-8269-68c2c182b069 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:38 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:38 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 1073741824 Apr 16 14:42:38 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:38 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 1G" returned: 0 in 0.483s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae1b83e-bee4-483f-9b1a-b07cca4f7a4d]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:38 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 Apr 16 14:42:38 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:38 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 1073741824" returned: 0 in 0.486s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:38 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 Apr 16 14:42:38 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:38 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146" returned: 0 in 0.478s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:38 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 Apr 16 14:42:38 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:39 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069" returned: 0 in 0.430s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbe1f70-32f6-44d6-bc3f-1acf6ca0abba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97645559-dae2-4116-8269-68c2c182b069', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69923aa-6efa-4c57-9359-ab998c530d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:39 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Volume volume-97645559-dae2-4116-8269-68c2c182b069 (97645559-dae2-4116-8269-68c2c182b069): created successfully Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69923aa-6efa-4c57-9359-ab998c530d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Flow 'volume_create_manager' (86716ad1-ab25-44d7-b049-86b45bfc1c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:39 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5497d292-4f97-4e1a-8cf2-df2776e95edd tempest-VolumesSnapshotTestJSON-831749411 None] Created volume successfully. Apr 16 14:42:39 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146" returned: 1 in 0.473s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Downloaded image a03b4007-0186-44e1-a560-91d8e58559a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}])) to volume 6565d192-49e3-4055-8729-cec34ed0f146 successfully. {{(pid=83305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Temporary image a03b4007-0186-44e1-a560-91d8e58559a1 for user 2ba7c523b97b424b9667255174a55d8c is deleted. {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Marking volume 6565d192-49e3-4055-8729-cec34ed0f146 as bootable. {{(pid=83305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Copying metadata from image a03b4007-0186-44e1-a560-91d8e58559a1 to 6565d192-49e3-4055-8729-cec34ed0f146. {{(pid=83305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Creating volume glance metadata for volume 6565d192-49e3-4055-8729-cec34ed0f146 backed by image a03b4007-0186-44e1-a560-91d8e58559a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afd5c08-849b-49bf-be20-bfd23d51a958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6565d192-49e3-4055-8729-cec34ed0f146', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90789902-11c2-48a6-9c8f-5e4eda57602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:39 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Volume volume-6565d192-49e3-4055-8729-cec34ed0f146 (6565d192-49e3-4055-8729-cec34ed0f146): created successfully Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90789902-11c2-48a6-9c8f-5e4eda57602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Flow 'volume_create_manager' (fefae34f-eab0-4fa4-8cd1-50ff501f01f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:39 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-d0d2f3ca-ca5e-44c4-adcb-e909d2db22b1 tempest-VolumesImageMetadata-126086009 None] Created volume successfully. Apr 16 14:42:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] Creating offline snapshot 74d52339-8819-4cc1-a624-d6edf5d747e6 of volume 97645559-dae2-4116-8269-68c2c182b069 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:42:40 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebd56d9-f14c-4519-9700-1c43eeb74238]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Acquiring lock "cinder-6565d192-49e3-4055-8729-cec34ed0f146-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Lock "cinder-6565d192-49e3-4055-8729-cec34ed0f146-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:40 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 Apr 16 14:42:40 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Acquiring lock "cinder-quobyte-6565d192-49e3-4055-8729-cec34ed0f146" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Lock "cinder-quobyte-6565d192-49e3-4055-8729-cec34ed0f146" acquired by "delete_volume" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:40 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4f9930-b96d-436f-a28b-8d6e002b4e55]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:40 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 Apr 16 14:42:40 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:41 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069" returned: 0 in 0.577s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:41 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 1G Apr 16 14:42:41 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:41 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146" returned: 0 in 0.494s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:41 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 Apr 16 14:42:41 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:41 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 1G" returned: 0 in 0.553s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97645559-dae2-4116-8269-68c2c182b069 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:41 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97645559-dae2-4116-8269-68c2c182b069 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 Apr 16 14:42:41 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:41 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146" returned: 1 in 0.520s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:42:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:41 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146 Apr 16 14:42:41 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:42 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97645559-dae2-4116-8269-68c2c182b069 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6" returned: 0 in 0.429s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:42 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 is being set with open permissions: ugo+rw Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:42 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6565d192-49e3-4055-8729-cec34ed0f146" returned: 0 in 0.398s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:42 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 Apr 16 14:42:42 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Lock "cinder-quobyte-6565d192-49e3-4055-8729-cec34ed0f146" released by "delete_volume" :: held 1.457s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Created reservations ['4357cd83-26f5-4bca-be0b-942cb454bc06', '7d0f380d-ca9d-48dc-a419-f747fe53d8b3', 'f6e4597c-687f-46ae-b3d7-c147246b7c3f', '3bac02e2-3a4c-4ed3-826c-8f2fecf1bfa1'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:42 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:42 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:42 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6" returned: 0 in 0.422s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:42 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.info Apr 16 14:42:42 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:42 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.432s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:42 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Deleted volume successfully. Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96f3cf1f-545e-4bf4-bf6e-8bf0d4e8ed62 tempest-VolumesImageMetadata-126086009 None] Lock "cinder-6565d192-49e3-4055-8729-cec34ed0f146-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:42 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.info" returned: 0 in 0.485s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:42 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.info is being set with open permissions: ugo+rw Apr 16 14:42:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:43 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.info Apr 16 14:42:43 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:43 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.info" returned: 0 in 0.482s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.012s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:43 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-c79b030a-36a0-46ae-869e-f2231e7b0209 tempest-VolumesSnapshotTestJSON-831749411 None] Create snapshot completed successfully Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Flow 'volume_create_manager' (c2ee9a21-56ab-4418-b1a3-bc92ce489a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca85c0d2-bc5e-4098-b185-14e0bbf47d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca85c0d2-bc5e-4098-b185-14e0bbf47d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-345183970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cb2edd-48f6-4393-ba1f-0539173eb608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e8d399beaf4fd1be5870e6ca2c26ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:45Z,use_quota=True,user_id='3820b37772d946da95830f3f805a9fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a557e4f5-fdb5-4521-9952-b73ee24b732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a557e4f5-fdb5-4521-9952-b73ee24b732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fd63da-2141-4e46-b771-6d0099623733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fd63da-2141-4e46-b771-6d0099623733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61cb2edd-48f6-4393-ba1f-0539173eb608', 'volume_name': 'volume-61cb2edd-48f6-4393-ba1f-0539173eb608', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d37e1c3-2b7a-483a-960e-b0acf2684573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d37e1c3-2b7a-483a-960e-b0acf2684573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d2d236-daa5-4d51-a03d-314034922397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:44 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Volume 61cb2edd-48f6-4393-ba1f-0539173eb608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61cb2edd-48f6-4393-ba1f-0539173eb608', 'volume_size': 1} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-345183970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cb2edd-48f6-4393-ba1f-0539173eb608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e8d399beaf4fd1be5870e6ca2c26ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:45Z,use_quota=True,user_id='3820b37772d946da95830f3f805a9fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Creating volume 61cb2edd-48f6-4393-ba1f-0539173eb608 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:44 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:44 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 1073741824 Apr 16 14:42:44 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-74d52339-8819-4cc1-a624-d6edf5d747e6-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-74d52339-8819-4cc1-a624-d6edf5d747e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-97645559-dae2-4116-8269-68c2c182b069" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-97645559-dae2-4116-8269-68c2c182b069" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-74d52339-8819-4cc1-a624-d6edf5d747e6" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-74d52339-8819-4cc1-a624-d6edf5d747e6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Deleting offline snapshot 74d52339-8819-4cc1-a624-d6edf5d747e6 of volume 97645559-dae2-4116-8269-68c2c182b069 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] snapshot_file for this snap is: volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a19d054-9dfe-4d8c-b01c-0d8486a7937a]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:44 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 Apr 16 14:42:44 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:45 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 1073741824" returned: 0 in 0.488s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:45 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 Apr 16 14:42:45 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:45 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6" returned: 0 in 0.481s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97645559-dae2-4116-8269-68c2c182b069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3537bb6b-f0d0-435f-9928-f273f26763ff]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:45 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 Apr 16 14:42:45 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:45 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608" returned: 0 in 0.426s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d2d236-daa5-4d51-a03d-314034922397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61cb2edd-48f6-4393-ba1f-0539173eb608', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714c19cb-69a4-4e81-9fe4-b083f29c8c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:45 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Volume volume-61cb2edd-48f6-4393-ba1f-0539173eb608 (61cb2edd-48f6-4393-ba1f-0539173eb608): created successfully Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714c19cb-69a4-4e81-9fe4-b083f29c8c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Flow 'volume_create_manager' (c2ee9a21-56ab-4418-b1a3-bc92ce489a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:45 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-315c2b95-a7e3-472f-985a-0eeb8af48cf0 tempest-SnapshotMetadataTestJSON-1780626140 None] Created volume successfully. Apr 16 14:42:45 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069" returned: 0 in 0.498s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:45 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 Apr 16 14:42:45 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:46 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6" returned: 0 in 0.433s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:46 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6 Apr 16 14:42:46 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo_service.periodic_task [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:46 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:46 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] Creating offline snapshot 2be88c13-677b-4a89-a92a-c6fd35cc005f of volume 61cb2edd-48f6-4393-ba1f-0539173eb608 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbb8bad-f299-454c-9cee-4ff31c0c4c99]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:46 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069.74d52339-8819-4cc1-a624-d6edf5d747e6" returned: 0 in 0.507s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-74d52339-8819-4cc1-a624-d6edf5d747e6" released by "_delete_snapshot" :: held 1.980s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-97645559-dae2-4116-8269-68c2c182b069" released by "delete_snapshot" :: held 1.995s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:46 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 Apr 16 14:42:46 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Created reservations ['ef4aec1c-c171-442e-a4e7-7992763221f7', '0269d229-6b00-4a5e-9540-13280bf978f8', '4adaffef-3444-431e-9d4b-1864f628dc18', '5b35a19e-05ec-4f4c-814d-1e67db64388b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:46 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Delete snapshot completed successfully. Apr 16 14:42:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-52d5d265-8b3e-44c6-acbb-0e132aff6d2c tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-74d52339-8819-4cc1-a624-d6edf5d747e6-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:47 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.495s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:47 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:47 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608" returned: 0 in 0.477s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:47 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f 1G Apr 16 14:42:47 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:47 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f 1G" returned: 0 in 0.455s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61cb2edd-48f6-4393-ba1f-0539173eb608 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:47 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61cb2edd-48f6-4393-ba1f-0539173eb608 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f Apr 16 14:42:47 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:48 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61cb2edd-48f6-4393-ba1f-0539173eb608 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f" returned: 0 in 0.463s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:48 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f is being set with open permissions: ugo+rw Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:48 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f Apr 16 14:42:48 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Flow 'volume_create_manager' (7b87e9f1-a833-43c4-bb9b-ddb1df6b120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f134252-52bf-4ba3-8ef5-01a053c235ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f134252-52bf-4ba3-8ef5-01a053c235ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-934879961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36180a2a-6089-4af0-8223-9f97dfbd272d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c7f9c7194f469e9d4e01447f751db8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:48Z,use_quota=True,user_id='45a9c52518b743728b733ecf986c5a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b4f3a0-b5aa-4d86-853d-d77bef2c6c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b4f3a0-b5aa-4d86-853d-d77bef2c6c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbc8473-1845-49c8-a238-8cad1acad94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbc8473-1845-49c8-a238-8cad1acad94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36180a2a-6089-4af0-8223-9f97dfbd272d', 'volume_name': 'volume-36180a2a-6089-4af0-8223-9f97dfbd272d', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fada5887-7d6e-45bf-988d-b2016ce2fe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fada5887-7d6e-45bf-988d-b2016ce2fe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c28bbc5-8ba1-4216-bdc1-f7a0e0cfadae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:48 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Volume 36180a2a-6089-4af0-8223-9f97dfbd272d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36180a2a-6089-4af0-8223-9f97dfbd272d', 'volume_size': 1} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:48 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f" returned: 0 in 0.394s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:48 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.info Apr 16 14:42:48 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:48 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.info" returned: 0 in 0.398s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:48 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.info is being set with open permissions: ugo+rw Apr 16 14:42:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:48 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.info Apr 16 14:42:48 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:49 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.info" returned: 0 in 0.420s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.679s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.156s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-934879961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36180a2a-6089-4af0-8223-9f97dfbd272d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c7f9c7194f469e9d4e01447f751db8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:48Z,use_quota=True,user_id='45a9c52518b743728b733ecf986c5a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Creating volume 36180a2a-6089-4af0-8223-9f97dfbd272d {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:49 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:49 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d 1073741824 Apr 16 14:42:49 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:49 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-29fc22ed-4997-4a5d-a074-916648e9020f tempest-SnapshotMetadataTestJSON-1780626140 None] Create snapshot completed successfully Apr 16 14:42:49 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d 1073741824" returned: 0 in 0.497s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:49 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d Apr 16 14:42:49 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Acquiring lock "cinder-2be88c13-677b-4a89-a92a-c6fd35cc005f-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "cinder-2be88c13-677b-4a89-a92a-c6fd35cc005f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Acquiring lock "cinder-quobyte-61cb2edd-48f6-4393-ba1f-0539173eb608" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "cinder-quobyte-61cb2edd-48f6-4393-ba1f-0539173eb608" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Acquiring lock "cinder-quobyte-2be88c13-677b-4a89-a92a-c6fd35cc005f" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "cinder-quobyte-2be88c13-677b-4a89-a92a-c6fd35cc005f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Deleting offline snapshot 2be88c13-677b-4a89-a92a-c6fd35cc005f of volume 61cb2edd-48f6-4393-ba1f-0539173eb608 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] snapshot_file for this snap is: volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ed0477-8277-46d4-87b4-7fc17579f318]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:50 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d" returned: 0 in 0.455s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c28bbc5-8ba1-4216-bdc1-f7a0e0cfadae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36180a2a-6089-4af0-8223-9f97dfbd272d', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939b98ac-0bf4-4e69-9cff-b2846d577330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:50 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Volume volume-36180a2a-6089-4af0-8223-9f97dfbd272d (36180a2a-6089-4af0-8223-9f97dfbd272d): created successfully Apr 16 14:42:50 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f Apr 16 14:42:50 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939b98ac-0bf4-4e69-9cff-b2846d577330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Flow 'volume_create_manager' (7b87e9f1-a833-43c4-bb9b-ddb1df6b120c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:50 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5217547f-b899-4f3d-b1f1-0b4b4f0f3b7b tempest-VolumesSnapshotTestJSON-831749411 None] Created volume successfully. Apr 16 14:42:50 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f" returned: 0 in 0.447s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61cb2edd-48f6-4393-ba1f-0539173eb608(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[95668982-65e4-49e2-9e8f-3ecced9e4830]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:50 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 Apr 16 14:42:50 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:51 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608" returned: 0 in 0.461s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:51 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f Apr 16 14:42:51 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] Creating offline snapshot e06d0bbd-4796-4391-b1a1-994a3119415c of volume 36180a2a-6089-4af0-8223-9f97dfbd272d {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:42:51 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[682e363c-aec5-4e35-ac8e-03662361fb4d]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:51 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d Apr 16 14:42:51 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:51 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f" returned: 0 in 0.472s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:51 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f Apr 16 14:42:51 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:51 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d" returned: 0 in 0.483s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:51 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c 1G Apr 16 14:42:51 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:52 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608.2be88c13-677b-4a89-a92a-c6fd35cc005f" returned: 0 in 0.403s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "cinder-quobyte-2be88c13-677b-4a89-a92a-c6fd35cc005f" released by "_delete_snapshot" :: held 1.837s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "cinder-quobyte-61cb2edd-48f6-4393-ba1f-0539173eb608" released by "delete_snapshot" :: held 1.848s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Created reservations ['d42cbfe1-6264-41c8-8f4f-c111e010b005', '3fef5394-ee53-402c-90ac-314ad45f8492', 'd6c368e6-02b4-4673-a247-0ecdfd2626c5', 'c8998397-7860-4db5-93e9-9883068891a6'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:52 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Delete snapshot completed successfully. Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3f8097d4-619a-41d4-b3a7-8031082068ab tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "cinder-2be88c13-677b-4a89-a92a-c6fd35cc005f-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:52 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c 1G" returned: 0 in 0.495s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36180a2a-6089-4af0-8223-9f97dfbd272d -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:52 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36180a2a-6089-4af0-8223-9f97dfbd272d -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c Apr 16 14:42:52 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Acquiring lock "cinder-61cb2edd-48f6-4393-ba1f-0539173eb608-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "cinder-61cb2edd-48f6-4393-ba1f-0539173eb608-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Acquiring lock "cinder-quobyte-61cb2edd-48f6-4393-ba1f-0539173eb608" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "cinder-quobyte-61cb2edd-48f6-4393-ba1f-0539173eb608" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[427900b8-c262-4635-b704-65337cd98645]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:52 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 Apr 16 14:42:52 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:52 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36180a2a-6089-4af0-8223-9f97dfbd272d -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c" returned: 0 in 0.416s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:52 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c is being set with open permissions: ugo+rw Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:52 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c Apr 16 14:42:52 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:52 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608" returned: 0 in 0.462s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:52 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608 Apr 16 14:42:52 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:53 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c" returned: 0 in 0.393s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:53 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.info Apr 16 14:42:53 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:53 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-61cb2edd-48f6-4393-ba1f-0539173eb608" returned: 0 in 0.385s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "cinder-quobyte-61cb2edd-48f6-4393-ba1f-0539173eb608" released by "delete_volume" :: held 0.876s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Created reservations ['4a0c90c9-2a6d-45f7-935c-bab58e27d21f', '6e5672fb-1b36-4f76-adee-60ba56f856c8', 'd3a511de-9a65-49d8-afcb-d7ffa732c2a5', '2955b1b6-3254-45c2-9148-eadfa02e16e1'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:53 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:42:53 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:53 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.info" returned: 0 in 0.467s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:53 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.info is being set with open permissions: ugo+rw Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:53 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.info Apr 16 14:42:53 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:53 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.423s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:42:53 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Deleted volume successfully. Apr 16 14:42:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b8185e84-6f6f-42e0-a678-b131c741b8ca tempest-SnapshotMetadataTestJSON-1780626140 None] Lock "cinder-61cb2edd-48f6-4393-ba1f-0539173eb608-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:54 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.info" returned: 0 in 0.492s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.804s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:54 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-64ca4d57-0ec0-4c19-a12a-157cbd5ddfce tempest-VolumesSnapshotTestJSON-831749411 None] Create snapshot completed successfully Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Flow 'volume_create_manager' (88eb2fc5-0c31-499f-9823-1daf38c70c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36576139-ad31-4dbe-be9e-be53a2daebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36576139-ad31-4dbe-be9e-be53a2daebbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-21092950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bee1f8-86aa-4c0f-b17c-dad1cc99be69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c7f9c7194f469e9d4e01447f751db8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e06d0bbd-4796-4391-b1a1-994a3119415c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:55Z,use_quota=True,user_id='45a9c52518b743728b733ecf986c5a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b276ab-8d69-4d38-86b1-24a61b4ff3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b276ab-8d69-4d38-86b1-24a61b4ff3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5220a1-3984-4471-a758-52335e480a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5220a1-3984-4471-a758-52335e480a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '56bee1f8-86aa-4c0f-b17c-dad1cc99be69', 'volume_name': 'volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69', 'volume_size': 2, 'snapshot_id': 'e06d0bbd-4796-4391-b1a1-994a3119415c'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37dc3f5-bf34-424f-a89d-fb660d7d6bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37dc3f5-bf34-424f-a89d-fb660d7d6bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99452ae4-cadc-4cc8-b4ad-3274a661c7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:54 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Volume 56bee1f8-86aa-4c0f-b17c-dad1cc99be69: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69', 'volume_size': 2, 'snapshot_id': 'e06d0bbd-4796-4391-b1a1-994a3119415c'} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-e06d0bbd-4796-4391-b1a1-994a3119415c-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" by "_create_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-e06d0bbd-4796-4391-b1a1-994a3119415c-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Creating volume 56bee1f8-86aa-4c0f-b17c-dad1cc99be69 from snapshot e06d0bbd-4796-4391-b1a1-994a3119415c {{(pid=83305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] snapshot: e06d0bbd-4796-4391-b1a1-994a3119415c, volume: 56bee1f8-86aa-4c0f-b17c-dad1cc99be69, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf3807b-f286-4b9a-a5ca-cf9f4f8827de]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:54 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c Apr 16 14:42:54 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Flow 'volume_create_manager' (3ac5b791-3ee2-45c8-9f4b-256887db2de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63f672b-1cd9-4cc5-b6a6-222a0f5a0fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63f672b-1cd9-4cc5-b6a6-222a0f5a0fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1744666662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44cf15e3-43e9-4ec2-b782-4f5f372792a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63d5b34766c4c71918c6495452ffce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:55Z,use_quota=True,user_id='8abed27343be40f697cd28fa26acfff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04d5b48-d406-477c-8724-cead60c815f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04d5b48-d406-477c-8724-cead60c815f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8f7d9b-ed26-4c86-be01-49202d871f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8f7d9b-ed26-4c86-be01-49202d871f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44cf15e3-43e9-4ec2-b782-4f5f372792a0', 'volume_name': 'volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2cdb5b-4f58-480c-8a62-e75595628a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2cdb5b-4f58-480c-8a62-e75595628a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a65328e-d781-44f8-bdb4-93c30dc95887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:55 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Volume 44cf15e3-43e9-4ec2-b782-4f5f372792a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0', 'volume_size': 1} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:55 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c" returned: 0 in 0.485s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36180a2a-6089-4af0-8223-9f97dfbd272d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c1be73-b97b-4e26-87a4-caa600156ec3]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:55 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d Apr 16 14:42:55 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:55 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d" returned: 0 in 0.446s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:42:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:55 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 Apr 16 14:42:55 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:57 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" returned: 0 in 1.785s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:57 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc20891-d845-4c57-81c6-a22a02788005]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:57 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d Apr 16 14:42:57 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:58 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d" returned: 0 in 0.564s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d, size 1024.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:42:58 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Converted 1024.00 MB image at 573.18 MB/s Apr 16 14:42:58 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 is being set with open permissions: ugo+rw Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:58 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 Apr 16 14:42:58 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:58 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" returned: 0 in 0.385s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" released by "_copy_volume_from_snapshot" :: held 3.717s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-e06d0bbd-4796-4391-b1a1-994a3119415c-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" released by "_create_volume_from_snapshot" :: held 3.740s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.748s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.326s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1744666662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44cf15e3-43e9-4ec2-b782-4f5f372792a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63d5b34766c4c71918c6495452ffce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:42:55Z,use_quota=True,user_id='8abed27343be40f697cd28fa26acfff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Creating volume 44cf15e3-43e9-4ec2-b782-4f5f372792a0 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:42:58 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:58 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 1073741824 Apr 16 14:42:58 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99452ae4-cadc-4cc8-b4ad-3274a661c7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69', 'volume_size': 2, 'snapshot_id': 'e06d0bbd-4796-4391-b1a1-994a3119415c'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b26bb36-13d2-4a9c-90f3-e42eb7a5d48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:58 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Volume volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 (56bee1f8-86aa-4c0f-b17c-dad1cc99be69): created successfully Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b26bb36-13d2-4a9c-90f3-e42eb7a5d48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Flow 'volume_create_manager' (88eb2fc5-0c31-499f-9823-1daf38c70c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:58 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e7572c82-c068-4065-9df6-1321aee804f6 tempest-VolumesSnapshotTestJSON-831749411 None] Created volume successfully. Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-56bee1f8-86aa-4c0f-b17c-dad1cc99be69-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:59 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-56bee1f8-86aa-4c0f-b17c-dad1cc99be69-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 1073741824" returned: 0 in 0.487s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7995caf-04de-4198-9620-05ec4cfc94cd]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:59 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 Apr 16 14:42:59 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:59 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 Apr 16 14:42:59 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:59 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0" returned: 0 in 0.395s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a65328e-d781-44f8-bdb4-93c30dc95887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2022891-2401-4f90-87fc-e850a77a556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:42:59 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Volume volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 (44cf15e3-43e9-4ec2-b782-4f5f372792a0): created successfully Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2022891-2401-4f90-87fc-e850a77a556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Flow 'volume_create_manager' (3ac5b791-3ee2-45c8-9f4b-256887db2de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:42:59 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5e74202e-6fa3-462e-8e10-39630fd22e66 tempest-VolumesDeleteCascade-1930044678 None] Created volume successfully. Apr 16 14:42:59 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" returned: 0 in 0.470s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:42:59 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69 Apr 16 14:42:59 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:42:59 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" returned: 0 in 0.385s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:42:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-56bee1f8-86aa-4c0f-b17c-dad1cc99be69" released by "delete_volume" :: held 0.881s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Created reservations ['ff9adc05-2c85-4c18-8877-d266ffb1588d', 'b7a5d2b0-d537-4e13-86e8-58360be15b6f', '58e67992-2897-4cf4-9939-8f91517abb1f', 'f76eadcf-0a8b-47db-8c61-d6ce7ab66900'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:00 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:00 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-e06d0bbd-4796-4391-b1a1-994a3119415c-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-e06d0bbd-4796-4391-b1a1-994a3119415c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-36180a2a-6089-4af0-8223-9f97dfbd272d" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-36180a2a-6089-4af0-8223-9f97dfbd272d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-e06d0bbd-4796-4391-b1a1-994a3119415c" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-e06d0bbd-4796-4391-b1a1-994a3119415c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Deleting offline snapshot e06d0bbd-4796-4391-b1a1-994a3119415c of volume 36180a2a-6089-4af0-8223-9f97dfbd272d {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] snapshot_file for this snap is: volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf748ba1-3457-4d65-b979-8abb2aff6564]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:00 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c Apr 16 14:43:00 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:00 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.412s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:00 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Deleted volume successfully. Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-94a0d8d7-7a90-413c-be7d-8e4b77563c38 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-56bee1f8-86aa-4c0f-b17c-dad1cc99be69-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] Creating offline snapshot e0086711-887f-4458-9e3c-446a8eb191d0 of volume 44cf15e3-43e9-4ec2-b782-4f5f372792a0 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b5cbe9-7f7d-4351-a89e-4bb82fb8cd3f]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:00 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 Apr 16 14:43:00 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:00 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c" returned: 0 in 0.487s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36180a2a-6089-4af0-8223-9f97dfbd272d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9963a215-7ce9-4518-91a6-3078dd397dc5]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:00 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d Apr 16 14:43:00 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:01 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0" returned: 0 in 0.447s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:01 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 1G Apr 16 14:43:01 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:01 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d" returned: 0 in 0.458s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:01 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c Apr 16 14:43:01 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:01 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 1G" returned: 0 in 0.475s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:01 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 Apr 16 14:43:01 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:01 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c" returned: 0 in 0.462s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:01 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c Apr 16 14:43:01 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:02 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0" returned: 0 in 0.440s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:02 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 is being set with open permissions: ugo+rw Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:02 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 Apr 16 14:43:02 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:02 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d.e06d0bbd-4796-4391-b1a1-994a3119415c" returned: 0 in 0.410s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-e06d0bbd-4796-4391-b1a1-994a3119415c" released by "_delete_snapshot" :: held 1.868s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-36180a2a-6089-4af0-8223-9f97dfbd272d" released by "delete_snapshot" :: held 1.885s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Created reservations ['5d0f3087-469c-4320-bb66-d02b8bbddcad', '6b734801-8f78-4b3b-a1e8-f8012995986e', 'e38e88b6-a73d-431d-a067-ec66446188c6', '00c51902-5bd5-4682-8edf-b608d0892780'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:02 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Delete snapshot completed successfully. Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05d4ad0f-503e-4449-8da7-59757f5d41de tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-e06d0bbd-4796-4391-b1a1-994a3119415c-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-36180a2a-6089-4af0-8223-9f97dfbd272d-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-36180a2a-6089-4af0-8223-9f97dfbd272d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-36180a2a-6089-4af0-8223-9f97dfbd272d" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-36180a2a-6089-4af0-8223-9f97dfbd272d" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c994926e-28df-455f-a1b6-5a0e6eb38030]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:02 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0" returned: 0 in 0.430s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:02 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.info Apr 16 14:43:02 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:02 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d Apr 16 14:43:02 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:02 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.info" returned: 0 in 0.418s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:02 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.info is being set with open permissions: ugo+rw Apr 16 14:43:02 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d" returned: 0 in 0.459s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:02 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.info Apr 16 14:43:02 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:02 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d Apr 16 14:43:02 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:03 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.info" returned: 0 in 0.393s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:03 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-36180a2a-6089-4af0-8223-9f97dfbd272d" returned: 0 in 0.449s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-36180a2a-6089-4af0-8223-9f97dfbd272d" released by "delete_volume" :: held 0.937s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:03 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-ddb01e25-6760-4632-9905-8862fc5efa5c tempest-VolumesDeleteCascade-1930044678 None] Create snapshot completed successfully Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Created reservations ['2a5f0680-b1ca-4329-80c2-85b5d5d7e1d7', 'f434c499-3cf6-47ae-8358-067b56758ab6', 'c6b9fc42-c5f5-4aea-befa-14e20acd58c9', 'e8f547c2-7d92-4136-8766-0d491102a68a'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:03 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:03 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Flow 'volume_create_manager' (504ec7f6-c585-4619-bf55-55c31d17cfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4ede0b-f3b7-4d0a-ad23-0cd628f18155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4ede0b-f3b7-4d0a-ad23-0cd628f18155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1405124108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4cd480-82d9-45c6-bcb0-0506f8ee1009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c7f9c7194f469e9d4e01447f751db8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:04Z,use_quota=True,user_id='45a9c52518b743728b733ecf986c5a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc18a743-d2bb-4dc8-b72d-1e918921ebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc18a743-d2bb-4dc8-b72d-1e918921ebd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102c42cc-2b20-4c47-bd03-e6553b58efd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102c42cc-2b20-4c47-bd03-e6553b58efd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf4cd480-82d9-45c6-bcb0-0506f8ee1009', 'volume_name': 'volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e780f641-b149-489f-b928-3546fd0bf856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e780f641-b149-489f-b928-3546fd0bf856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d178ab-6661-41e3-8a70-09a781e4448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:03 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Volume cf4cd480-82d9-45c6-bcb0-0506f8ee1009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009', 'volume_size': 1} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1405124108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4cd480-82d9-45c6-bcb0-0506f8ee1009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c7f9c7194f469e9d4e01447f751db8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:04Z,use_quota=True,user_id='45a9c52518b743728b733ecf986c5a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Creating volume cf4cd480-82d9-45c6-bcb0-0506f8ee1009 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:03 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:03 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 1073741824 Apr 16 14:43:03 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:03 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.509s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:03 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Deleted volume successfully. Apr 16 14:43:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-42d814d8-d47c-4101-ba67-790ba657e166 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-36180a2a-6089-4af0-8223-9f97dfbd272d-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:04 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 1073741824" returned: 0 in 0.477s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:04 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 Apr 16 14:43:04 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:04 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" returned: 0 in 0.384s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.818s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] Creating offline snapshot 0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 of volume 44cf15e3-43e9-4ec2-b782-4f5f372792a0 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d178ab-6661-41e3-8a70-09a781e4448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442a7ebb-ad1e-49df-bac2-96aa8370b8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5718de70-4d5b-4b7f-86dd-cb45900f1d8f]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:04 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Volume volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 (cf4cd480-82d9-45c6-bcb0-0506f8ee1009): created successfully Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442a7ebb-ad1e-49df-bac2-96aa8370b8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Flow 'volume_create_manager' (504ec7f6-c585-4619-bf55-55c31d17cfb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:04 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-68361f54-7755-4328-900c-4eb77ead76ee tempest-VolumesSnapshotTestJSON-831749411 None] Created volume successfully. Apr 16 14:43:04 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 Apr 16 14:43:04 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:05 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0" returned: 0 in 0.466s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:05 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 1G Apr 16 14:43:05 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:05 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 1G" returned: 0 in 0.469s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:05 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 Apr 16 14:43:05 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:06 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4" returned: 0 in 0.446s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:06 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 is being set with open permissions: ugo+rw Apr 16 14:43:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:06 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 Apr 16 14:43:06 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:06 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4" returned: 0 in 0.390s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.601s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] Creating offline snapshot c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f of volume cf4cd480-82d9-45c6-bcb0-0506f8ee1009 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:43:06 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5fd31692-3b2d-4059-9de1-eb32b92f7ba4 tempest-VolumesDeleteCascade-1930044678 None] Create snapshot completed successfully Apr 16 14:43:06 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[adad9d1c-0b33-4e5a-bba4-ba019992a21e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:06 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 Apr 16 14:43:06 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-44cf15e3-43e9-4ec2-b782-4f5f372792a0-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-44cf15e3-43e9-4ec2-b782-4f5f372792a0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:07 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" returned: 0 in 0.494s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Performing cascade delete. {{(pid=83305) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:07 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f 1G Apr 16 14:43:07 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-quobyte-44cf15e3-43e9-4ec2-b782-4f5f372792a0" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-44cf15e3-43e9-4ec2-b782-4f5f372792a0" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-quobyte-0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Deleting offline snapshot 0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 of volume 44cf15e3-43e9-4ec2-b782-4f5f372792a0 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] snapshot_file for this snap is: volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[70be1076-ee87-4e55-9cd4-68c2a223ed04]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:07 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 Apr 16 14:43:07 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:07 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f 1G" returned: 0 in 0.451s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:07 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f Apr 16 14:43:07 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:07 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4" returned: 0 in 0.490s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c52e59-3a03-434b-b74a-b7a0264495c6]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:07 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 Apr 16 14:43:07 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:07 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f" returned: 0 in 0.421s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:07 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f is being set with open permissions: ugo+rw Apr 16 14:43:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:08 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f Apr 16 14:43:08 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:08 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0" returned: 0 in 0.456s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:08 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 Apr 16 14:43:08 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:08 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f" returned: 0 in 0.407s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:08 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.info Apr 16 14:43:08 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:08 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4" returned: 0 in 0.448s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:08 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4 Apr 16 14:43:08 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:08 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.info" returned: 0 in 0.405s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:08 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.info is being set with open permissions: ugo+rw Apr 16 14:43:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:08 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.info Apr 16 14:43:08 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:08 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4" returned: 0 in 0.398s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4" released by "_delete_snapshot" :: held 1.834s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-44cf15e3-43e9-4ec2-b782-4f5f372792a0" released by "delete_snapshot" :: held 1.844s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Created reservations ['f6d47f2c-242f-4b6c-90bc-fdcfa33b99e4', 'e231b4fa-03dc-40d7-9e45-b203ff8382a7', 'a0f0aec5-d160-449c-9639-dc767f0e7541', '7cb61297-75d0-4d74-9304-9d4174faf596'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:09 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Delete snapshot completed successfully. Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-0ea7a52c-99f2-41c1-b4b0-28dd2c8584a4-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-e0086711-887f-4458-9e3c-446a8eb191d0-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-e0086711-887f-4458-9e3c-446a8eb191d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-quobyte-44cf15e3-43e9-4ec2-b782-4f5f372792a0" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-44cf15e3-43e9-4ec2-b782-4f5f372792a0" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-quobyte-e0086711-887f-4458-9e3c-446a8eb191d0" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-e0086711-887f-4458-9e3c-446a8eb191d0" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Deleting offline snapshot e0086711-887f-4458-9e3c-446a8eb191d0 of volume 44cf15e3-43e9-4ec2-b782-4f5f372792a0 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] snapshot_file for this snap is: volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea91474-ef71-4162-8114-b57d91729a54]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:09 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 Apr 16 14:43:09 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:09 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.info" returned: 0 in 0.421s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:09 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-0d2a6ae2-cf02-4015-8def-a1a13417d9fb tempest-VolumesSnapshotTestJSON-831749411 None] Create snapshot completed successfully Apr 16 14:43:09 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0" returned: 0 in 0.461s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ed4bdf-51bf-4893-85ec-c9d6cfe70769]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:09 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 Apr 16 14:43:09 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:10 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0" returned: 0 in 0.441s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:10 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 Apr 16 14:43:10 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Flow 'volume_create_manager' (981db717-23db-4d3a-82cf-7963f0514f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a102afc-b1a3-4bfd-9af7-54812d317f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a102afc-b1a3-4bfd-9af7-54812d317f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1258153048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c7f9c7194f469e9d4e01447f751db8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:10Z,use_quota=True,user_id='45a9c52518b743728b733ecf986c5a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1138f6c4-5fad-47a8-8f6e-9f29d18405f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1138f6c4-5fad-47a8-8f6e-9f29d18405f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ae13b8-99b6-4fa8-bc1c-97ed488f5a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ae13b8-99b6-4fa8-bc1c-97ed488f5a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c', 'volume_name': 'volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c', 'volume_size': 1, 'snapshot_id': 'c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5bb587-9d27-4353-be48-0ed988c605e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5bb587-9d27-4353-be48-0ed988c605e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda2a1d4-3650-4e0d-8b7c-60f3098d3fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:10 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Volume 9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c', 'volume_size': 1, 'snapshot_id': 'c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f'} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" by "_create_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Creating volume 9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c from snapshot c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f {{(pid=83305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] snapshot: c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f, volume: 9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee1e76-c1b3-4720-8e78-f328eb3fbae8]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:10 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0" returned: 0 in 0.489s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:10 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0 Apr 16 14:43:10 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:10 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f Apr 16 14:43:10 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:10 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0.e0086711-887f-4458-9e3c-446a8eb191d0" returned: 0 in 0.401s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-e0086711-887f-4458-9e3c-446a8eb191d0" released by "_delete_snapshot" :: held 1.833s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:10 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-44cf15e3-43e9-4ec2-b782-4f5f372792a0" released by "delete_snapshot" :: held 1.843s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f" returned: 0 in 0.452s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5674203e-41ec-40be-b19d-5b425882ba74]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Created reservations ['2ad88dde-a6f5-4e50-b786-797cab24ee65', 'd8f4aa30-ad89-4616-98d5-190217581093', '451d8e5f-124e-4b7c-a9b2-0b5ae09a9499', '3a12bf5c-049a-4618-bb3a-f064d235f511'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:11 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Delete snapshot completed successfully. Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-e0086711-887f-4458-9e3c-446a8eb191d0-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Snapshots deleted, issuing volume delete {{(pid=83305) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-quobyte-44cf15e3-43e9-4ec2-b782-4f5f372792a0" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-44cf15e3-43e9-4ec2-b782-4f5f372792a0" acquired by "delete_volume" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:11 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 Apr 16 14:43:11 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f3ba29-6eeb-41de-94a6-5b4e7e9ba8f2]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:11 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 Apr 16 14:43:11 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:11 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" returned: 0 in 0.482s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:11 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c Apr 16 14:43:11 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:11 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0" returned: 0 in 0.461s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:11 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0 Apr 16 14:43:11 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:11 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-44cf15e3-43e9-4ec2-b782-4f5f372792a0" returned: 0 in 0.413s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-44cf15e3-43e9-4ec2-b782-4f5f372792a0" released by "delete_volume" :: held 0.921s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:12 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:DELETE=10,cinder:UPDATE=173,cinder:SELECT=156,cinder:INSERT=47 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:43:12 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Created reservations ['b729d403-1b4f-4192-88f8-8ef9451200bb', '3b104416-e6bc-4bc9-bb6d-01a8678c3aed', '1acc6d28-c13b-4bdf-8078-011227376b17', '3a01f44b-1ed3-402a-b72f-bd480012b7f1'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:12 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:12 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:13 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.874s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:13 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Deleted volume successfully. Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=141,cinder:INSERT=52,cinder:UPDATE=149,cinder:DELETE=18 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-f53b4f5f-1b7d-4465-8cf4-ec719cda6f2c tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-44cf15e3-43e9-4ec2-b782-4f5f372792a0-delete_volume" released by "delete_volume" :: held 5.989s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:13 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" returned: 0 in 2.004s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a241a50d-53f0-407a-8eb9-de99e2c94f04]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Flow 'volume_create_manager' (e977a426-c22b-4a81-90c5-01f38530baf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6868fc95-9fec-4fe3-b29c-ef53d0ef14e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6868fc95-9fec-4fe3-b29c-ef53d0ef14e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1230975226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf7b1ea-122c-4af3-88be-accb32369f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63d5b34766c4c71918c6495452ffce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:13Z,use_quota=True,user_id='8abed27343be40f697cd28fa26acfff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:13 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 Apr 16 14:43:13 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a49069-19ff-4acd-89c7-5cf80c257139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a49069-19ff-4acd-89c7-5cf80c257139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19a51b0-5a72-480c-87f8-d1ecd1102125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19a51b0-5a72-480c-87f8-d1ecd1102125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf7b1ea-122c-4af3-88be-accb32369f8a', 'volume_name': 'volume-daf7b1ea-122c-4af3-88be-accb32369f8a', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6af2bf8-7bc2-43ee-9628-371daae2c2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6af2bf8-7bc2-43ee-9628-371daae2c2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b761073-3252-4d64-9a00-874b07cf21dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:13 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Volume daf7b1ea-122c-4af3-88be-accb32369f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf7b1ea-122c-4af3-88be-accb32369f8a', 'volume_size': 1} Apr 16 14:43:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:14 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" returned: 0 in 0.579s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:43:14 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Converted 1024.00 MB image at 510.62 MB/s Apr 16 14:43:14 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c is being set with open permissions: ugo+rw Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:14 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c Apr 16 14:43:14 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:14 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" returned: 0 in 0.386s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" released by "_copy_volume_from_snapshot" :: held 3.956s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" released by "_create_volume_from_snapshot" :: held 3.971s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.978s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1230975226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf7b1ea-122c-4af3-88be-accb32369f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63d5b34766c4c71918c6495452ffce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:13Z,use_quota=True,user_id='8abed27343be40f697cd28fa26acfff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Creating volume daf7b1ea-122c-4af3-88be-accb32369f8a {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:14 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:14 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a 1073741824 Apr 16 14:43:14 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda2a1d4-3650-4e0d-8b7c-60f3098d3fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c', 'volume_size': 1, 'snapshot_id': 'c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedcfcee-c9fe-468b-8cd9-01bd35da917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:14 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Volume volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c (9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c): created successfully Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedcfcee-c9fe-468b-8cd9-01bd35da917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Flow 'volume_create_manager' (981db717-23db-4d3a-82cf-7963f0514f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:14 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-ad2a9f0d-6d29-4a46-86ee-3906158f835b tempest-VolumesSnapshotTestJSON-831749411 None] Created volume successfully. Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5a3ee2-cdf5-44fe-b73b-6f510a7b1d87]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:14 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c Apr 16 14:43:14 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:14 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a 1073741824" returned: 0 in 0.496s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:15 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a Apr 16 14:43:15 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:15 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" returned: 0 in 0.482s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:15 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c Apr 16 14:43:15 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:15 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a" returned: 0 in 0.397s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b761073-3252-4d64-9a00-874b07cf21dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf7b1ea-122c-4af3-88be-accb32369f8a', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6370084-7549-478f-bcd2-2ee24c559f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:15 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Volume volume-daf7b1ea-122c-4af3-88be-accb32369f8a (daf7b1ea-122c-4af3-88be-accb32369f8a): created successfully Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6370084-7549-478f-bcd2-2ee24c559f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Flow 'volume_create_manager' (e977a426-c22b-4a81-90c5-01f38530baf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:15 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-9a903204-5c31-43a5-8331-ad77553ca5b9 tempest-VolumesDeleteCascade-1930044678 None] Created volume successfully. Apr 16 14:43:15 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" returned: 0 in 0.414s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c" released by "delete_volume" :: held 0.923s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] Creating offline snapshot 87a92e0e-ef63-416e-868a-8b2c03de0d45 of volume daf7b1ea-122c-4af3-88be-accb32369f8a {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22523e8a-2494-4938-a4a6-a7ef819256a6]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Created reservations ['19c67c12-09a9-4995-8f93-5f36800c5a13', '29df1e26-6205-4f1c-bf7f-f28c631f9a8a', '41669231-169c-4e7f-bdae-ff93716d0763', 'b57e0678-f83b-488e-9916-68ec88ef60c2'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:15 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a Apr 16 14:43:15 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:15 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:15 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Deleting offline snapshot c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f of volume cf4cd480-82d9-45c6-bcb0-0506f8ee1009 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] snapshot_file for this snap is: volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9099bb4e-fa34-4c52-a2ae-2e8a7944ec21]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:16 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f Apr 16 14:43:16 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:16 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a" returned: 0 in 0.517s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:16 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.420s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:16 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 1G Apr 16 14:43:16 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Deleted volume successfully. Apr 16 14:43:16 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-af342a68-5fdb-42d5-8177-8060a9b6f29a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-9d3d3ba4-e24e-43ef-a9db-4f4eab5e588c-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:16 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f" returned: 0 in 0.480s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b74097-bb8e-4c11-9308-80d4d4430442]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:16 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 Apr 16 14:43:16 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:16 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 1G" returned: 0 in 0.462s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf7b1ea-122c-4af3-88be-accb32369f8a -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:16 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf7b1ea-122c-4af3-88be-accb32369f8a -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 Apr 16 14:43:16 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:16 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" returned: 0 in 0.479s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:17 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f Apr 16 14:43:17 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:17 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf7b1ea-122c-4af3-88be-accb32369f8a -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45" returned: 0 in 0.457s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:17 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 is being set with open permissions: ugo+rw Apr 16 14:43:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:17 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 Apr 16 14:43:17 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:17 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f" returned: 0 in 0.458s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:17 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f Apr 16 14:43:17 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:17 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45" returned: 0 in 0.411s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:17 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.info Apr 16 14:43:17 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:17 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009.c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f" returned: 0 in 0.417s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f" released by "_delete_snapshot" :: held 1.880s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" released by "delete_snapshot" :: held 1.893s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:17 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Created reservations ['50b96552-ef55-49fb-b896-c6bf323226ba', 'eb848c5b-c201-44c8-840f-89657569d122', '63b21ba1-4e65-4c01-ac35-ff5f2d59f8a6', '9dd0cf57-b905-4b7f-ac50-fdfa68eabefc'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:17 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Delete snapshot completed successfully. Apr 16 14:43:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e6be43a5-3f47-4c15-b896-70c659b58098 tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-c5413176-f0a8-4f10-a0f9-c3eb6dd6b75f-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:18 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.info" returned: 0 in 0.436s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:18 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.info is being set with open permissions: ugo+rw Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-cf4cd480-82d9-45c6-bcb0-0506f8ee1009-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:18 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.info Apr 16 14:43:18 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-cf4cd480-82d9-45c6-bcb0-0506f8ee1009-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" acquired by "delete_volume" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c341c338-9c16-40cd-b868-db2d23a23338]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:18 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 Apr 16 14:43:18 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:18 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.info" returned: 0 in 0.429s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.776s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:18 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-6ebcca89-8983-4c2d-ac3a-813b8928a549 tempest-VolumesDeleteCascade-1930044678 None] Create snapshot completed successfully Apr 16 14:43:18 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" returned: 0 in 0.441s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:18 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009 Apr 16 14:43:18 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:19 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" returned: 0 in 0.407s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-cf4cd480-82d9-45c6-bcb0-0506f8ee1009" released by "delete_volume" :: held 0.882s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Created reservations ['f1eb59ba-35d1-4201-a02f-3827a3a66df0', 'cbe471ba-ec55-41c4-9999-19aeb771dcee', 'f348d992-5d8c-49e2-ba67-598d774a90cf', '311db22d-55a8-4436-bd3d-6b889af10bb4'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Flow 'volume_create_manager' (3422106f-c6ed-4ecc-a354-29882d2b045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2c5366-e410-445b-92ef-10909fe1ae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2c5366-e410-445b-92ef-10909fe1ae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2056431913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e79301-dffd-4dfd-9102-0196ccdd9def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63d5b34766c4c71918c6495452ffce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=87a92e0e-ef63-416e-868a-8b2c03de0d45,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:19Z,use_quota=True,user_id='8abed27343be40f697cd28fa26acfff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0211cf7-a94a-4a6f-ac13-d916988e66ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0211cf7-a94a-4a6f-ac13-d916988e66ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab76e7b2-7320-4ea8-bc90-ab479468f686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab76e7b2-7320-4ea8-bc90-ab479468f686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40e79301-dffd-4dfd-9102-0196ccdd9def', 'volume_name': 'volume-40e79301-dffd-4dfd-9102-0196ccdd9def', 'volume_size': 1, 'snapshot_id': '87a92e0e-ef63-416e-868a-8b2c03de0d45'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ef81bf-bbfd-4dfe-94dc-fcbf1bee28f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ef81bf-bbfd-4dfe-94dc-fcbf1bee28f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e2ae04-0f3d-4317-a590-de79691ee969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:19 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Volume 40e79301-dffd-4dfd-9102-0196ccdd9def: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40e79301-dffd-4dfd-9102-0196ccdd9def', 'volume_size': 1, 'snapshot_id': '87a92e0e-ef63-416e-868a-8b2c03de0d45'} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-quobyte-87a92e0e-ef63-416e-868a-8b2c03de0d45-40e79301-dffd-4dfd-9102-0196ccdd9def" by "_create_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-87a92e0e-ef63-416e-868a-8b2c03de0d45-40e79301-dffd-4dfd-9102-0196ccdd9def" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Creating volume 40e79301-dffd-4dfd-9102-0196ccdd9def from snapshot 87a92e0e-ef63-416e-868a-8b2c03de0d45 {{(pid=83305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-quobyte-40e79301-dffd-4dfd-9102-0196ccdd9def" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-40e79301-dffd-4dfd-9102-0196ccdd9def" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] snapshot: 87a92e0e-ef63-416e-868a-8b2c03de0d45, volume: 40e79301-dffd-4dfd-9102-0196ccdd9def, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:43:19 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:19 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbdf152-330c-4abb-8795-478eee8997a4]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-97645559-dae2-4116-8269-68c2c182b069-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-97645559-dae2-4116-8269-68c2c182b069-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "cinder-quobyte-97645559-dae2-4116-8269-68c2c182b069" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-97645559-dae2-4116-8269-68c2c182b069" acquired by "delete_volume" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e98c3a-3439-45a7-a746-1c0a74db40b3]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:19 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 Apr 16 14:43:19 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:19 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 Apr 16 14:43:19 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:19 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.426s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:19 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Deleted volume successfully. Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-96e1643a-c44a-4775-a9e1-1bfb32dd5f3e tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-cf4cd480-82d9-45c6-bcb0-0506f8ee1009-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:19 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45" returned: 0 in 0.477s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daf7b1ea-122c-4af3-88be-accb32369f8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04da5660-8c1b-46a2-ad14-96629cc7f4da]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:19 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a Apr 16 14:43:19 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:19 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069" returned: 0 in 0.500s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:19 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069 Apr 16 14:43:19 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:20 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a" returned: 0 in 0.476s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:20 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-97645559-dae2-4116-8269-68c2c182b069" returned: 0 in 0.414s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:20 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def Apr 16 14:43:20 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-quobyte-97645559-dae2-4116-8269-68c2c182b069" released by "delete_volume" :: held 0.939s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Created reservations ['ea3bf621-2408-40ae-a5af-56a97531720d', '817e4d8b-4acd-4493-afdd-1f8cec6628a2', '6903ace1-8a2f-4554-94cd-20fd62206091', 'f2370ddf-1a93-4d26-b976-91495050f71a'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:20 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:20 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:21 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.799s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:21 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:21 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Deleted volume successfully. Apr 16 14:43:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-bc104f47-55d9-47c5-a012-59e35243f81a tempest-VolumesSnapshotTestJSON-831749411 None] Lock "cinder-97645559-dae2-4116-8269-68c2c182b069-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:22 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def" returned: 0 in 2.009s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:22 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e04e6a6-fe85-4f88-b98d-e37b52f0473c]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:22 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a Apr 16 14:43:22 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:22 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a" returned: 0 in 0.651s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:22 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:43:22 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Converted 1024.00 MB image at 509.43 MB/s Apr 16 14:43:22 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def is being set with open permissions: ugo+rw Apr 16 14:43:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:22 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def Apr 16 14:43:22 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:23 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def" returned: 0 in 0.483s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-40e79301-dffd-4dfd-9102-0196ccdd9def" released by "_copy_volume_from_snapshot" :: held 4.157s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-87a92e0e-ef63-416e-868a-8b2c03de0d45-40e79301-dffd-4dfd-9102-0196ccdd9def" released by "_create_volume_from_snapshot" :: held 4.191s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.209s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e2ae04-0f3d-4317-a590-de79691ee969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e79301-dffd-4dfd-9102-0196ccdd9def', 'volume_size': 1, 'snapshot_id': '87a92e0e-ef63-416e-868a-8b2c03de0d45'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df58db8-76b2-41d0-8fb2-4a78b0766319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:23 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Volume volume-40e79301-dffd-4dfd-9102-0196ccdd9def (40e79301-dffd-4dfd-9102-0196ccdd9def): created successfully Apr 16 14:43:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df58db8-76b2-41d0-8fb2-4a78b0766319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Flow 'volume_create_manager' (3422106f-c6ed-4ecc-a354-29882d2b045d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:23 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b35d74d5-9d58-448b-88c8-482982093e92 tempest-VolumesDeleteCascade-1930044678 None] Created volume successfully. Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-daf7b1ea-122c-4af3-88be-accb32369f8a-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-daf7b1ea-122c-4af3-88be-accb32369f8a-delete_volume" acquired by "delete_volume" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Performing cascade delete. {{(pid=83305) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-87a92e0e-ef63-416e-868a-8b2c03de0d45-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-87a92e0e-ef63-416e-868a-8b2c03de0d45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-quobyte-daf7b1ea-122c-4af3-88be-accb32369f8a" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-daf7b1ea-122c-4af3-88be-accb32369f8a" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-quobyte-87a92e0e-ef63-416e-868a-8b2c03de0d45" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-87a92e0e-ef63-416e-868a-8b2c03de0d45" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Deleting offline snapshot 87a92e0e-ef63-416e-868a-8b2c03de0d45 of volume daf7b1ea-122c-4af3-88be-accb32369f8a {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] snapshot_file for this snap is: volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecc8ae2-fa6a-4a58-91b2-0b87a641706b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:24 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 Apr 16 14:43:24 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Flow 'volume_create_manager' (d6e02492-103d-4fda-8804-7d925d4c0de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:25 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308943cd-bc68-46bb-ac73-c6385b71b94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45" returned: 0 in 0.544s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daf7b1ea-122c-4af3-88be-accb32369f8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4df334-ef41-4a26-9ff6-582457730f33]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308943cd-bc68-46bb-ac73-c6385b71b94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432346674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d715ff2f-47f7-4985-8992-036a9ea2c89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307ae74061764d46b407b95926433669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:25Z,use_quota=True,user_id='d142ad1b5dfb4a2bac72d0e7cc3d938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01aa2853-dbb7-474d-9315-2fe84bd1620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01aa2853-dbb7-474d-9315-2fe84bd1620a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502c4353-3a22-4888-9f85-6bbb06ff1068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502c4353-3a22-4888-9f85-6bbb06ff1068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd715ff2f-47f7-4985-8992-036a9ea2c89c', 'volume_name': 'volume-d715ff2f-47f7-4985-8992-036a9ea2c89c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892a5748-8a33-4a58-94c2-29e3b1612254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892a5748-8a33-4a58-94c2-29e3b1612254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d256bb97-2ccf-4aab-8c87-22d5486a26d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Volume d715ff2f-47f7-4985-8992-036a9ea2c89c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d715ff2f-47f7-4985-8992-036a9ea2c89c', 'volume_size': 1} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432346674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d715ff2f-47f7-4985-8992-036a9ea2c89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307ae74061764d46b407b95926433669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:25Z,use_quota=True,user_id='d142ad1b5dfb4a2bac72d0e7cc3d938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Creating volume d715ff2f-47f7-4985-8992-036a9ea2c89c {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:25 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:25 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a Apr 16 14:43:25 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:25 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c 1073741824 Apr 16 14:43:25 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Flow 'volume_create_manager' (f7e9ff1e-6ed8-4d63-8840-e45897949338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e714fbfa-2074-42bd-8448-8366c5d28ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e714fbfa-2074-42bd-8448-8366c5d28ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1732093914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49087a36-402a-4415-b0b2-85bc50db9982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307ae74061764d46b407b95926433669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:25Z,use_quota=True,user_id='d142ad1b5dfb4a2bac72d0e7cc3d938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a56ad4-d9a3-4cb5-a4e1-25e3fa166f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a56ad4-d9a3-4cb5-a4e1-25e3fa166f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831d8382-336d-43ec-9fc9-37f64edd0e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831d8382-336d-43ec-9fc9-37f64edd0e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49087a36-402a-4415-b0b2-85bc50db9982', 'volume_name': 'volume-49087a36-402a-4415-b0b2-85bc50db9982', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5f49be-b74d-4f90-b013-e7e2644f2579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5f49be-b74d-4f90-b013-e7e2644f2579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27ceb70-df52-4b0d-b7ba-cd5cb166bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Volume 49087a36-402a-4415-b0b2-85bc50db9982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49087a36-402a-4415-b0b2-85bc50db9982', 'volume_size': 1} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Flow 'volume_create_manager' (732b42b9-6d81-42a6-9297-9fa4281adbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346e7999-e700-413a-98db-3f59ffa2983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346e7999-e700-413a-98db-3f59ffa2983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606782405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20be5d9e-9ee2-461f-aeac-e801c945f8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307ae74061764d46b407b95926433669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:26Z,use_quota=True,user_id='d142ad1b5dfb4a2bac72d0e7cc3d938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b28e87-e468-4439-9596-0b3211439e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b28e87-e468-4439-9596-0b3211439e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03cd30a-3182-4d5d-ab5f-e2b64715a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03cd30a-3182-4d5d-ab5f-e2b64715a24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20be5d9e-9ee2-461f-aeac-e801c945f8d4', 'volume_name': 'volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6811bf75-f95c-45f1-91f6-a557b37cbd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6811bf75-f95c-45f1-91f6-a557b37cbd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97659d0-77cd-43cd-ae64-a9ed67fe42ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Volume 20be5d9e-9ee2-461f-aeac-e801c945f8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4', 'volume_size': 1} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:25 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a" returned: 0 in 0.510s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:25 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 Apr 16 14:43:25 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Flow 'volume_create_manager' (b3606e30-f1b4-446b-8847-cea83bddfcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8251f9e8-c539-46d9-8c1d-23b1042c3638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8251f9e8-c539-46d9-8c1d-23b1042c3638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1774518961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38dc7c2-d726-4d41-bb1b-74c1bb42cf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307ae74061764d46b407b95926433669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:26Z,use_quota=True,user_id='d142ad1b5dfb4a2bac72d0e7cc3d938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200d734a-5e69-4bed-ad8e-ef3d49501444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200d734a-5e69-4bed-ad8e-ef3d49501444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5874441-e5ae-40d6-b57e-13fce365240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5874441-e5ae-40d6-b57e-13fce365240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38dc7c2-d726-4d41-bb1b-74c1bb42cf78', 'volume_name': 'volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081e92a9-5332-485b-8a7c-36d36bbc7d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081e92a9-5332-485b-8a7c-36d36bbc7d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050bc631-762e-4af7-a604-5d49eeffd37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:25 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Volume e38dc7c2-d726-4d41-bb1b-74c1bb42cf78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78', 'volume_size': 1} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c 1073741824" returned: 0 in 0.651s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:25 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c Apr 16 14:43:25 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Flow 'volume_create_manager' (8a2f7370-b21e-48e6-a20d-e1e51e37b88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fd4cd8-9c03-4492-85e2-a8f795caa951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fd4cd8-9c03-4492-85e2-a8f795caa951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601379829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb69b84b-2e63-4eef-94b8-071be26d16b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307ae74061764d46b407b95926433669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:26Z,use_quota=True,user_id='d142ad1b5dfb4a2bac72d0e7cc3d938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1d65e7-f6a7-4076-82e9-a39733e54b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1d65e7-f6a7-4076-82e9-a39733e54b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff941790-b08b-44b9-b1b8-a86c3f22a77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff941790-b08b-44b9-b1b8-a86c3f22a77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb69b84b-2e63-4eef-94b8-071be26d16b9', 'volume_name': 'volume-eb69b84b-2e63-4eef-94b8-071be26d16b9', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd08450-25a7-4288-bbf6-76e56f6ec703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd08450-25a7-4288-bbf6-76e56f6ec703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29048597-6d4d-4f9f-bb79-d1d1e5f899a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:26 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Volume eb69b84b-2e63-4eef-94b8-071be26d16b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb69b84b-2e63-4eef-94b8-071be26d16b9', 'volume_size': 1} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:26 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45" returned: 0 in 0.497s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:26 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45 Apr 16 14:43:26 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:26 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c" returned: 0 in 0.435s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1732093914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49087a36-402a-4415-b0b2-85bc50db9982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307ae74061764d46b407b95926433669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:25Z,use_quota=True,user_id='d142ad1b5dfb4a2bac72d0e7cc3d938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Creating volume 49087a36-402a-4415-b0b2-85bc50db9982 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:26 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d256bb97-2ccf-4aab-8c87-22d5486a26d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d715ff2f-47f7-4985-8992-036a9ea2c89c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d537ca23-ad8d-4fc0-9ab8-c890e2461df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:26 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982 1073741824 Apr 16 14:43:26 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:26 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Volume volume-d715ff2f-47f7-4985-8992-036a9ea2c89c (d715ff2f-47f7-4985-8992-036a9ea2c89c): created successfully Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d537ca23-ad8d-4fc0-9ab8-c890e2461df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Flow 'volume_create_manager' (d6e02492-103d-4fda-8804-7d925d4c0de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:26 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b0554ea3-cc3f-4de3-a77d-a01d10594386 tempest-CreateVolumesFromImageTest-1706559534 None] Created volume successfully. Apr 16 14:43:26 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a.87a92e0e-ef63-416e-868a-8b2c03de0d45" returned: 0 in 0.406s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-87a92e0e-ef63-416e-868a-8b2c03de0d45" released by "_delete_snapshot" :: held 2.008s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-daf7b1ea-122c-4af3-88be-accb32369f8a" released by "delete_snapshot" :: held 2.020s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Created reservations ['99178f7d-1400-4732-af8e-9e6d09845b1c', '1bc8eed0-ca5b-4d28-8e73-e5ffa02cf0f0', '1aa96884-f680-466f-a6ad-9c9f443a9d28', '09eb4d40-427a-40f9-ba85-23c18731032b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:26 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Delete snapshot completed successfully. Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-87a92e0e-ef63-416e-868a-8b2c03de0d45-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Snapshots deleted, issuing volume delete {{(pid=83305) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-quobyte-daf7b1ea-122c-4af3-88be-accb32369f8a" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-daf7b1ea-122c-4af3-88be-accb32369f8a" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d5c86f-9b33-40a5-b087-e8d313111d73]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:26 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a Apr 16 14:43:26 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:26 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982 1073741824" returned: 0 in 0.489s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:26 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982 Apr 16 14:43:26 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:27 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a" returned: 0 in 0.474s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:27 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a Apr 16 14:43:27 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:27 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982" returned: 0 in 0.425s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.629s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606782405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20be5d9e-9ee2-461f-aeac-e801c945f8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307ae74061764d46b407b95926433669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:26Z,use_quota=True,user_id='d142ad1b5dfb4a2bac72d0e7cc3d938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Creating volume 20be5d9e-9ee2-461f-aeac-e801c945f8d4 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:27 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27ceb70-df52-4b0d-b7ba-cd5cb166bad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49087a36-402a-4415-b0b2-85bc50db9982', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebae9d8-5a19-40c5-a1f7-92774578b700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:27 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4 1073741824 Apr 16 14:43:27 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:27 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Volume volume-49087a36-402a-4415-b0b2-85bc50db9982 (49087a36-402a-4415-b0b2-85bc50db9982): created successfully Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebae9d8-5a19-40c5-a1f7-92774578b700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Flow 'volume_create_manager' (f7e9ff1e-6ed8-4d63-8840-e45897949338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:27 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-445e23c5-361e-4654-b8c9-3186d1c5ab52 tempest-CreateVolumesFromImageTest-1706559534 None] Created volume successfully. Apr 16 14:43:27 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-daf7b1ea-122c-4af3-88be-accb32369f8a" returned: 0 in 0.435s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-daf7b1ea-122c-4af3-88be-accb32369f8a" released by "delete_volume" :: held 0.940s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Created reservations ['0fb2e64d-9f7e-4d4a-81c9-f209ca796c83', 'ed677af8-b81b-4e63-a4d0-f95a9a31af12', '24ec7719-9630-43a6-903d-47ed14475df8', '577ca5f5-de94-4315-9695-a8ad1787c981'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:27 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:27 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:27 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4 1073741824" returned: 0 in 0.530s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:27 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4 Apr 16 14:43:27 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-40e79301-dffd-4dfd-9102-0196ccdd9def-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-40e79301-dffd-4dfd-9102-0196ccdd9def-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "cinder-quobyte-40e79301-dffd-4dfd-9102-0196ccdd9def" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-40e79301-dffd-4dfd-9102-0196ccdd9def" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[55873263-97b1-4b09-85c2-142dabaec982]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:28 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def Apr 16 14:43:28 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:28 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.447s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:28 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Deleted volume successfully. Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b1e181ae-7479-455f-8ac9-e05e60d42d23 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-daf7b1ea-122c-4af3-88be-accb32369f8a-delete_volume" released by "delete_volume" :: held 3.711s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:28 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4" returned: 0 in 0.473s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.451s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1774518961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38dc7c2-d726-4d41-bb1b-74c1bb42cf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307ae74061764d46b407b95926433669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:26Z,use_quota=True,user_id='d142ad1b5dfb4a2bac72d0e7cc3d938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Creating volume e38dc7c2-d726-4d41-bb1b-74c1bb42cf78 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:28 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97659d0-77cd-43cd-ae64-a9ed67fe42ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9367ed0f-98c3-42da-8119-d8e1ea4e92a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:28 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78 1073741824 Apr 16 14:43:28 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:28 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Volume volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4 (20be5d9e-9ee2-461f-aeac-e801c945f8d4): created successfully Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9367ed0f-98c3-42da-8119-d8e1ea4e92a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Flow 'volume_create_manager' (732b42b9-6d81-42a6-9297-9fa4281adbc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:28 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-81a26699-f5ea-4590-8991-6c2c520ba0d6 tempest-CreateVolumesFromImageTest-1706559534 None] Created volume successfully. Apr 16 14:43:28 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def" returned: 0 in 0.495s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:28 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def Apr 16 14:43:28 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:28 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78 1073741824" returned: 0 in 0.492s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:28 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-40e79301-dffd-4dfd-9102-0196ccdd9def" returned: 0 in 0.401s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:28 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78 Apr 16 14:43:28 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-quobyte-40e79301-dffd-4dfd-9102-0196ccdd9def" released by "delete_volume" :: held 0.921s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Created reservations ['0630ed9f-3059-47f4-a87e-15cbad4e6c72', '7a71b698-84f9-4b3d-af34-4abd84599d7d', '94f7aefa-f93d-421e-80e3-136ad2bd6f5c', '7cc1ecd1-f7f0-4a0d-b2b5-e995033a0e04'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:28 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:28 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:29 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78" returned: 0 in 0.450s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.206s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601379829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb69b84b-2e63-4eef-94b8-071be26d16b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307ae74061764d46b407b95926433669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:26Z,use_quota=True,user_id='d142ad1b5dfb4a2bac72d0e7cc3d938c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Creating volume eb69b84b-2e63-4eef-94b8-071be26d16b9 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:29 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050bc631-762e-4af7-a604-5d49eeffd37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa03757-fc2b-4178-85ea-ca7dfb99f8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:29 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Volume volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78 (e38dc7c2-d726-4d41-bb1b-74c1bb42cf78): created successfully Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa03757-fc2b-4178-85ea-ca7dfb99f8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:29 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9 1073741824 Apr 16 14:43:29 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Flow 'volume_create_manager' (b3606e30-f1b4-446b-8847-cea83bddfcad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:29 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-8dcd01e8-2b26-4f19-b2ec-7315a7a29521 tempest-CreateVolumesFromImageTest-1706559534 None] Created volume successfully. Apr 16 14:43:29 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.476s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:29 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Deleted volume successfully. Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-37a88224-e1a8-4ea9-a1fd-ac96c6f60d63 tempest-VolumesDeleteCascade-1930044678 None] Lock "cinder-40e79301-dffd-4dfd-9102-0196ccdd9def-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:29 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9 1073741824" returned: 0 in 0.579s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:29 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9 Apr 16 14:43:29 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:30 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9" returned: 0 in 0.436s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29048597-6d4d-4f9f-bb79-d1d1e5f899a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb69b84b-2e63-4eef-94b8-071be26d16b9', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75748acc-7160-45df-ba66-f1c74c74efae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:30 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Volume volume-eb69b84b-2e63-4eef-94b8-071be26d16b9 (eb69b84b-2e63-4eef-94b8-071be26d16b9): created successfully Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75748acc-7160-45df-ba66-f1c74c74efae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Flow 'volume_create_manager' (8a2f7370-b21e-48e6-a20d-e1e51e37b88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:30 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-834039b7-9474-4ede-87dc-0a593c934266 tempest-CreateVolumesFromImageTest-1706559534 None] Created volume successfully. Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Flow 'volume_create_manager' (9b0746d4-e26d-443d-b114-c2497a3d0e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df78846-fa1c-42b3-a46b-1085ed079e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df78846-fa1c-42b3-a46b-1085ed079e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-643448691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2babaae1-13c5-44a2-9531-e8d51151cefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3996730ef574ac68a8f8e607f9b8f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:31Z,use_quota=True,user_id='9b09b2310a8349909cafd408f2336825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abffe1a-7945-43f2-aec7-ab4b8991d106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abffe1a-7945-43f2-aec7-ab4b8991d106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44634982-9a69-453d-a1f5-1b0403b76056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44634982-9a69-453d-a1f5-1b0403b76056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2babaae1-13c5-44a2-9531-e8d51151cefa', 'volume_name': 'volume-2babaae1-13c5-44a2-9531-e8d51151cefa', 'volume_size': 2}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb8468e-4d0c-4e35-b0d6-4a3bea91e80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb8468e-4d0c-4e35-b0d6-4a3bea91e80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81acf40e-7aab-45cf-a54d-5a8b76395ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:30 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Volume 2babaae1-13c5-44a2-9531-e8d51151cefa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2babaae1-13c5-44a2-9531-e8d51151cefa', 'volume_size': 2} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-643448691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2babaae1-13c5-44a2-9531-e8d51151cefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3996730ef574ac68a8f8e607f9b8f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:31Z,use_quota=True,user_id='9b09b2310a8349909cafd408f2336825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Creating volume 2babaae1-13c5-44a2-9531-e8d51151cefa {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:30 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa 2147483648 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:30 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa 2147483648 Apr 16 14:43:30 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:31 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa 2147483648" returned: 0 in 0.492s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:31 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa Apr 16 14:43:31 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "cinder-eb69b84b-2e63-4eef-94b8-071be26d16b9-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-eb69b84b-2e63-4eef-94b8-071be26d16b9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "cinder-quobyte-eb69b84b-2e63-4eef-94b8-071be26d16b9" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-quobyte-eb69b84b-2e63-4eef-94b8-071be26d16b9" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[667db84d-8ab6-4e1e-ac70-12f22bd842e2]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:31 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9 Apr 16 14:43:31 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:31 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa" returned: 0 in 0.431s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81acf40e-7aab-45cf-a54d-5a8b76395ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2babaae1-13c5-44a2-9531-e8d51151cefa', 'volume_size': 2}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9455f205-26ce-486a-87e4-8ff32bd76ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:31 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Volume volume-2babaae1-13c5-44a2-9531-e8d51151cefa (2babaae1-13c5-44a2-9531-e8d51151cefa): created successfully Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9455f205-26ce-486a-87e4-8ff32bd76ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Flow 'volume_create_manager' (9b0746d4-e26d-443d-b114-c2497a3d0e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:31 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-340e9984-b7ab-49a3-80e2-c2804e13caeb tempest-VolumesCloneNegativeTest-1173241632 None] Created volume successfully. Apr 16 14:43:32 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9" returned: 0 in 0.472s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:32 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9 Apr 16 14:43:32 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:32 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-eb69b84b-2e63-4eef-94b8-071be26d16b9" returned: 0 in 0.401s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-quobyte-eb69b84b-2e63-4eef-94b8-071be26d16b9" released by "delete_volume" :: held 0.907s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Created reservations ['365aa6a6-78d9-4d0f-a5c7-1caf668f78f0', '328d0799-a4aa-45ad-89f6-2826a3fab787', '182ec536-4771-4090-b5cd-6714044e5de5', 'a02653c4-b008-4574-982a-89ea57c66d89'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:32 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:32 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "cinder-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "cinder-quobyte-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-quobyte-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4976df2a-78a5-4eac-82d9-319448e8a923]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:32 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78 Apr 16 14:43:32 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Acquiring lock "cinder-2babaae1-13c5-44a2-9531-e8d51151cefa-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:32 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.437s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:32 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:32 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Deleted volume successfully. Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Lock "cinder-2babaae1-13c5-44a2-9531-e8d51151cefa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0d353ca6-17bb-4986-96e9-657810ee6ce4 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-eb69b84b-2e63-4eef-94b8-071be26d16b9-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Acquiring lock "cinder-quobyte-2babaae1-13c5-44a2-9531-e8d51151cefa" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Lock "cinder-quobyte-2babaae1-13c5-44a2-9531-e8d51151cefa" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba7ce1d-958d-4738-b05e-d4fd4cda05e9]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:33 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa Apr 16 14:43:33 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:33 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78" returned: 0 in 0.501s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:33 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78 Apr 16 14:43:33 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:33 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa" returned: 0 in 0.478s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:33 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa Apr 16 14:43:33 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:33 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78" returned: 0 in 0.425s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-quobyte-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78" released by "delete_volume" :: held 0.953s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Created reservations ['f30fe555-0b4a-4a75-9ed5-56515effdd9d', '783f701e-3ec5-452c-a4f3-5f7b6cbdcd39', '84e8e838-aa85-41fe-baec-d54dfabb918e', '647c38ec-057d-4680-8eaf-5b8a0291725f'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:33 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:33 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "cinder-20be5d9e-9ee2-461f-aeac-e801c945f8d4-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-20be5d9e-9ee2-461f-aeac-e801c945f8d4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "cinder-quobyte-20be5d9e-9ee2-461f-aeac-e801c945f8d4" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-quobyte-20be5d9e-9ee2-461f-aeac-e801c945f8d4" acquired by "delete_volume" :: waited 0.019s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97b20fc-9e65-4f69-8b8d-0539258f6df9]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:33 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4 Apr 16 14:43:33 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:34 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-2babaae1-13c5-44a2-9531-e8d51151cefa" returned: 0 in 0.479s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Lock "cinder-quobyte-2babaae1-13c5-44a2-9531-e8d51151cefa" released by "delete_volume" :: held 0.978s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Created reservations ['15eb7df0-c038-40b3-b9c8-da87e3d91cdc', '19c33a93-ba95-42f6-a0d1-c8035251f6e0', '2d66b3dd-211a-4126-9f45-92ad0b83e84e', '085bb055-b007-4727-8a37-dd84cd9aebe0'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:34 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:34 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:34 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.463s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:34 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Deleted volume successfully. Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7d339ad3-cf35-4613-a9bd-d66a66b87912 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-e38dc7c2-d726-4d41-bb1b-74c1bb42cf78-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:34 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4" returned: 0 in 0.496s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:34 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4 Apr 16 14:43:34 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:34 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.437s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:34 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Deleted volume successfully. Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-00a7608b-573d-4555-b99a-c3dbee38f74f tempest-VolumesCloneNegativeTest-1173241632 None] Lock "cinder-2babaae1-13c5-44a2-9531-e8d51151cefa-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:34 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-20be5d9e-9ee2-461f-aeac-e801c945f8d4" returned: 0 in 0.416s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-quobyte-20be5d9e-9ee2-461f-aeac-e801c945f8d4" released by "delete_volume" :: held 0.930s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Created reservations ['9e5885e2-1ebc-4191-87bf-5150cc88e769', '908ab1de-100f-486d-98a6-3ef47366a500', 'ce0f80a6-fdf9-4dee-bd3b-fa859e95d440', 'e9d9087b-eb69-410e-b986-8c11b9079d3b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:34 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:34 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "cinder-49087a36-402a-4415-b0b2-85bc50db9982-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-49087a36-402a-4415-b0b2-85bc50db9982-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "cinder-quobyte-49087a36-402a-4415-b0b2-85bc50db9982" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-quobyte-49087a36-402a-4415-b0b2-85bc50db9982" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b1071c-70af-47bb-b667-360f94f7330f]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:35 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982 Apr 16 14:43:35 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:35 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.458s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:35 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:35 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Deleted volume successfully. Apr 16 14:43:35 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-2c2e96d0-5a39-4cae-89b2-7ac55d85fbbb tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-20be5d9e-9ee2-461f-aeac-e801c945f8d4-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:35 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982" returned: 0 in 0.567s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:35 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982 Apr 16 14:43:35 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:36 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-49087a36-402a-4415-b0b2-85bc50db9982" returned: 0 in 0.454s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-quobyte-49087a36-402a-4415-b0b2-85bc50db9982" released by "delete_volume" :: held 1.053s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Created reservations ['af2db9a8-3966-4024-95b2-72dd4194e1ec', '4e843c21-2741-4f32-86fc-955817dda229', 'b3fe4547-846b-4f8c-a5b3-f6d50dcc3640', '5d1e0b95-8cc0-4224-9720-4bd6e35bd0ec'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:36 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:36 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:36 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.443s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:36 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Deleted volume successfully. Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-df7b941e-17d8-4adc-82f8-9f35c882e87f tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-49087a36-402a-4415-b0b2-85bc50db9982-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (7d725022-37c1-4f1e-ac49-c7fd3b6f60b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b4760d-9c84-4e9a-ba8f-1026de80af6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b4760d-9c84-4e9a-ba8f-1026de80af6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-151840173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0113656a-e182-4838-b913-a7f4d671f6ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:37Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751e9429-7914-4862-9ca6-23379a4b85d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751e9429-7914-4862-9ca6-23379a4b85d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2da7c2-6682-4a0f-8247-8ada51ace430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2da7c2-6682-4a0f-8247-8ada51ace430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0113656a-e182-4838-b913-a7f4d671f6ff', 'volume_name': 'volume-0113656a-e182-4838-b913-a7f4d671f6ff', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bac3b3e-5859-4ee4-b7d6-339c76bb1caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bac3b3e-5859-4ee4-b7d6-339c76bb1caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fa3ac9-d448-463c-81b0-2076ec00996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:36 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Volume 0113656a-e182-4838-b913-a7f4d671f6ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0113656a-e182-4838-b913-a7f4d671f6ff', 'volume_size': 1} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-151840173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0113656a-e182-4838-b913-a7f4d671f6ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:37Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Creating volume 0113656a-e182-4838-b913-a7f4d671f6ff {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:36 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:36 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff 1073741824 Apr 16 14:43:36 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "cinder-d715ff2f-47f7-4985-8992-036a9ea2c89c-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-d715ff2f-47f7-4985-8992-036a9ea2c89c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "cinder-quobyte-d715ff2f-47f7-4985-8992-036a9ea2c89c" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-quobyte-d715ff2f-47f7-4985-8992-036a9ea2c89c" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbe1c03-db1c-4f11-835b-f1e87b4ce430]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:37 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c Apr 16 14:43:37 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:37 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff 1073741824" returned: 0 in 0.492s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:37 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff Apr 16 14:43:37 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:37 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c" returned: 0 in 0.482s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:37 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c Apr 16 14:43:37 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:37 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff" returned: 0 in 0.418s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fa3ac9-d448-463c-81b0-2076ec00996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0113656a-e182-4838-b913-a7f4d671f6ff', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1abc94b-70e8-4cf0-afa5-93a620e855f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:37 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Volume volume-0113656a-e182-4838-b913-a7f4d671f6ff (0113656a-e182-4838-b913-a7f4d671f6ff): created successfully Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1abc94b-70e8-4cf0-afa5-93a620e855f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (7d725022-37c1-4f1e-ac49-c7fd3b6f60b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:37 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a7509814-a2a7-4794-bf72-8ea2caaa1d1b tempest-VolumesGetTest-1134503723 None] Created volume successfully. Apr 16 14:43:38 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-d715ff2f-47f7-4985-8992-036a9ea2c89c" returned: 0 in 0.414s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-quobyte-d715ff2f-47f7-4985-8992-036a9ea2c89c" released by "delete_volume" :: held 0.916s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Created reservations ['6d7a67eb-b65e-4927-bbfb-aea34e60e04a', '23221ab7-5857-4e33-a989-ed33979dec16', 'f43a4618-bc47-430c-a7fb-9714b9a9733e', '56338eed-63e0-4dfd-a31e-36a28e856e59'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:38 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:38 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:38 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.434s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:38 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Deleted volume successfully. Apr 16 14:43:38 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-95f0e877-8ada-40bf-a510-b66a83efb382 tempest-CreateVolumesFromImageTest-1706559534 None] Lock "cinder-d715ff2f-47f7-4985-8992-036a9ea2c89c-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (0cfb2e79-7eb3-447e-a816-7c870a992f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebd15a3-9ba8-48cf-9ac3-6fdf9094a4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebd15a3-9ba8-48cf-9ac3-6fdf9094a4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-358365255',display_name='tempest-VolumesGetTest-Volume-114129114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cbb5ee-fb02-41cd-a496-67123feaf0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:39Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9df9c8-0670-4090-b08a-82234eb066c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9df9c8-0670-4090-b08a-82234eb066c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68f64be-6e88-4f04-a7d4-8101a353b210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68f64be-6e88-4f04-a7d4-8101a353b210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0cbb5ee-fb02-41cd-a496-67123feaf0ae', 'volume_name': 'volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb010827-dd10-482f-9e5c-15dc829107eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb010827-dd10-482f-9e5c-15dc829107eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e528ea-f635-47e1-89de-c242c7043f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:39 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Volume e0cbb5ee-fb02-41cd-a496-67123feaf0ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae', 'volume_size': 1} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-358365255',display_name='tempest-VolumesGetTest-Volume-114129114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cbb5ee-fb02-41cd-a496-67123feaf0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:39Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Creating volume e0cbb5ee-fb02-41cd-a496-67123feaf0ae {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:39 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:39 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae 1073741824 Apr 16 14:43:39 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Flow 'volume_create_manager' (aaed1a4c-9f55-4a02-a6e5-1108ff219708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc7d678-312e-42b0-95e1-27fa6ccfd24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc7d678-312e-42b0-95e1-27fa6ccfd24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5d63e5-4288-45e4-b48c-337c7deea23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867b09a406f14c229d554564e6689560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:40Z,use_quota=True,user_id='d681cee57c864b1881a128ebbc001778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3f9a90-a8a6-4f8e-94f9-bc2de7f7c63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3f9a90-a8a6-4f8e-94f9-bc2de7f7c63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c68358b-505a-4b57-b13e-04cbb4bd6331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c68358b-505a-4b57-b13e-04cbb4bd6331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf5d63e5-4288-45e4-b48c-337c7deea23a', 'volume_name': 'volume-cf5d63e5-4288-45e4-b48c-337c7deea23a', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ec42c5-37dc-43a5-a6df-97d81ed32093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ec42c5-37dc-43a5-a6df-97d81ed32093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc3ee52-b69a-4cce-878a-9f4c1dd67163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:39 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Volume cf5d63e5-4288-45e4-b48c-337c7deea23a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf5d63e5-4288-45e4-b48c-337c7deea23a', 'volume_size': 1} Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:39 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae 1073741824" returned: 0 in 0.562s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:40 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae Apr 16 14:43:40 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:40 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae" returned: 0 in 0.406s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5d63e5-4288-45e4-b48c-337c7deea23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867b09a406f14c229d554564e6689560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:40Z,use_quota=True,user_id='d681cee57c864b1881a128ebbc001778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Creating volume cf5d63e5-4288-45e4-b48c-337c7deea23a {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:40 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e528ea-f635-47e1-89de-c242c7043f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:40 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a 1073741824 Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbc4f4b-c0d5-4274-9e24-3caf9e6d95b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:40 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:40 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Volume volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae (e0cbb5ee-fb02-41cd-a496-67123feaf0ae): created successfully Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbc4f4b-c0d5-4274-9e24-3caf9e6d95b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (0cfb2e79-7eb3-447e-a816-7c870a992f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:40 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-46bc424c-0680-458e-b926-e205051c23c7 tempest-VolumesGetTest-1134503723 None] Created volume successfully. Apr 16 14:43:40 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a 1073741824" returned: 0 in 0.476s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:40 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a Apr 16 14:43:40 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:41 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a" returned: 0 in 0.391s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc3ee52-b69a-4cce-878a-9f4c1dd67163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf5d63e5-4288-45e4-b48c-337c7deea23a', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0a0eec-d711-4a65-a068-f06c3725401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:41 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Volume volume-cf5d63e5-4288-45e4-b48c-337c7deea23a (cf5d63e5-4288-45e4-b48c-337c7deea23a): created successfully Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0a0eec-d711-4a65-a068-f06c3725401b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Flow 'volume_create_manager' (aaed1a4c-9f55-4a02-a6e5-1108ff219708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:41 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-49df9cc0-92bc-4002-975f-458faaa78a16 tempest-CinderUnicodeTest-1891851834 None] Created volume successfully. Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-e0cbb5ee-fb02-41cd-a496-67123feaf0ae-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Lock "cinder-e0cbb5ee-fb02-41cd-a496-67123feaf0ae-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-quobyte-e0cbb5ee-fb02-41cd-a496-67123feaf0ae" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-e0cbb5ee-fb02-41cd-a496-67123feaf0ae" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[257d3d5f-3049-4d66-bd56-7591742fe666]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:41 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae Apr 16 14:43:41 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:42 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae" returned: 0 in 0.495s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:42 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae Apr 16 14:43:42 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Flow 'volume_create_manager' (80f451c9-e818-4255-8c9a-43fb1c9b9516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7681726-e523-46b2-8d71-e2fd21b39ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7681726-e523-46b2-8d71-e2fd21b39ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-759335769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204b2e5e-1bc5-4315-8987-2218bf286d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867b09a406f14c229d554564e6689560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:42Z,use_quota=True,user_id='d681cee57c864b1881a128ebbc001778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1274558-d7a0-4943-9ae5-67d1eda1bed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1274558-d7a0-4943-9ae5-67d1eda1bed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4159fc-7cb0-4d00-9c89-8f01b32bb70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4159fc-7cb0-4d00-9c89-8f01b32bb70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '204b2e5e-1bc5-4315-8987-2218bf286d42', 'volume_name': 'volume-204b2e5e-1bc5-4315-8987-2218bf286d42', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee23acec-b2d8-4c8a-8aa4-9eb20d3e5c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee23acec-b2d8-4c8a-8aa4-9eb20d3e5c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36518a51-2fdf-43c9-bc3a-e29ba71f363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:42 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Volume 204b2e5e-1bc5-4315-8987-2218bf286d42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-204b2e5e-1bc5-4315-8987-2218bf286d42', 'volume_size': 1} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-759335769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204b2e5e-1bc5-4315-8987-2218bf286d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867b09a406f14c229d554564e6689560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:42Z,use_quota=True,user_id='d681cee57c864b1881a128ebbc001778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Creating volume 204b2e5e-1bc5-4315-8987-2218bf286d42 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:42 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:42 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 1073741824 Apr 16 14:43:42 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:42 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e0cbb5ee-fb02-41cd-a496-67123feaf0ae" returned: 0 in 0.434s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-e0cbb5ee-fb02-41cd-a496-67123feaf0ae" released by "delete_volume" :: held 0.960s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Created reservations ['01796c96-6a16-4180-90e8-1e98ef93e9eb', 'a4023947-f30b-4629-9bb4-c11ef9f16244', '7b79f87c-73db-4a4b-9483-234e48984f79', '79140239-4644-4df0-90d0-b8f92e1c4f8c'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:42 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:42 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-0113656a-e182-4838-b913-a7f4d671f6ff-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Lock "cinder-0113656a-e182-4838-b913-a7f4d671f6ff-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-quobyte-0113656a-e182-4838-b913-a7f4d671f6ff" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-0113656a-e182-4838-b913-a7f4d671f6ff" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf037567-4aa7-47ca-a657-1c69705936c9]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:42 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff Apr 16 14:43:42 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:42 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 1073741824" returned: 0 in 0.556s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:42 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 Apr 16 14:43:42 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:43 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.453s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:43 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Deleted volume successfully. Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b3dd5885-854c-4e5e-9940-0a4fed57efb2 tempest-VolumesGetTest-1134503723 None] Lock "cinder-e0cbb5ee-fb02-41cd-a496-67123feaf0ae-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:43 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42" returned: 0 in 0.392s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:43 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36518a51-2fdf-43c9-bc3a-e29ba71f363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204b2e5e-1bc5-4315-8987-2218bf286d42', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf02727b-7e17-49b7-86ec-60b398eff498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff" returned: 0 in 0.509s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:43 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Volume volume-204b2e5e-1bc5-4315-8987-2218bf286d42 (204b2e5e-1bc5-4315-8987-2218bf286d42): created successfully Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf02727b-7e17-49b7-86ec-60b398eff498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:43 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff Apr 16 14:43:43 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Flow 'volume_create_manager' (80f451c9-e818-4255-8c9a-43fb1c9b9516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:43 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-afc67093-4d3f-42f6-b6f6-d81466880f81 tempest-CinderUnicodeTest-1891851834 None] Created volume successfully. Apr 16 14:43:43 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0113656a-e182-4838-b913-a7f4d671f6ff" returned: 0 in 0.394s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-0113656a-e182-4838-b913-a7f4d671f6ff" released by "delete_volume" :: held 0.934s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Created reservations ['55d151f8-648d-4287-8225-bff030998689', '33eb1c98-d7d5-4346-89eb-1662f908ae8a', '7b50f830-8ae5-413c-99b2-37aec590f6a9', '21bff8ad-b3bd-42da-bbd9-390f8b4ed903'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:43 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:43 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (e6b89b08-c173-4364-a847-133dae509a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1527aa6a-959a-4d15-83be-2e56a6c9426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1527aa6a-959a-4d15-83be-2e56a6c9426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1871568282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07704e61-0ac4-4a6c-be95-9664625f4b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:44Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f136ab-7aa4-49b8-a31a-2c3f4eb2a63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f136ab-7aa4-49b8-a31a-2c3f4eb2a63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63dc208a-c57e-4709-849f-7cf33215d778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63dc208a-c57e-4709-849f-7cf33215d778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07704e61-0ac4-4a6c-be95-9664625f4b42', 'volume_name': 'volume-07704e61-0ac4-4a6c-be95-9664625f4b42', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20aac06-fb28-441e-a3ce-6ee49340ba7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20aac06-fb28-441e-a3ce-6ee49340ba7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b6c9af-28df-4e7f-8066-0495317be996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:44 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Volume 07704e61-0ac4-4a6c-be95-9664625f4b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07704e61-0ac4-4a6c-be95-9664625f4b42', 'volume_size': 1} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1871568282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07704e61-0ac4-4a6c-be95-9664625f4b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:44Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Creating volume 07704e61-0ac4-4a6c-be95-9664625f4b42 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:44 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:44 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 1073741824 Apr 16 14:43:44 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:44 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.423s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:44 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Deleted volume successfully. Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-62b21959-b87d-49b9-840d-73c509212a5e tempest-VolumesGetTest-1134503723 None] Lock "cinder-0113656a-e182-4838-b913-a7f4d671f6ff-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:44 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 1073741824" returned: 0 in 0.506s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:44 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 Apr 16 14:43:44 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:45 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42" returned: 0 in 0.393s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.568s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b6c9af-28df-4e7f-8066-0495317be996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07704e61-0ac4-4a6c-be95-9664625f4b42', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3b0a3e-4ccd-46c7-afa3-cd5ba45cbeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] Creating offline snapshot 06359e41-fa25-4277-8ef2-0da985733264 of volume 204b2e5e-1bc5-4315-8987-2218bf286d42 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:43:45 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Volume volume-07704e61-0ac4-4a6c-be95-9664625f4b42 (07704e61-0ac4-4a6c-be95-9664625f4b42): created successfully Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3b0a3e-4ccd-46c7-afa3-cd5ba45cbeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (e6b89b08-c173-4364-a847-133dae509a71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f2044a-a7c4-4820-8351-658f12d2c41f]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:45 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cf87f3ad-2e0f-4b08-a61f-4f0bd3b08ace tempest-VolumesGetTest-1134503723 None] Created volume successfully. Apr 16 14:43:45 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 Apr 16 14:43:45 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:45 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42" returned: 0 in 0.456s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:45 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 1G Apr 16 14:43:45 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:46 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 1G" returned: 0 in 0.441s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-204b2e5e-1bc5-4315-8987-2218bf286d42 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:46 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-204b2e5e-1bc5-4315-8987-2218bf286d42 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 Apr 16 14:43:46 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:46 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (4a1f7f31-970a-4d0f-9310-a9e64c28def0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5165c60c-9b47-42c3-9e4d-493e8014e09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-204b2e5e-1bc5-4315-8987-2218bf286d42 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264" returned: 0 in 0.457s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:46 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 is being set with open permissions: ugo+rw Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:46 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 Apr 16 14:43:46 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5165c60c-9b47-42c3-9e4d-493e8014e09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1878037159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e08f164d-918b-4b73-b911-f01661b59c5f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=07704e61-0ac4-4a6c-be95-9664625f4b42,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:46Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f10e69-0340-4f6a-abf6-7b5abed33230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f10e69-0340-4f6a-abf6-7b5abed33230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1799c3ae-b2ef-42af-b08b-8d46161100ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_service.periodic_task [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1799c3ae-b2ef-42af-b08b-8d46161100ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e08f164d-918b-4b73-b911-f01661b59c5f', 'volume_name': 'volume-e08f164d-918b-4b73-b911-f01661b59c5f', 'volume_size': 1, 'source_volid': '07704e61-0ac4-4a6c-be95-9664625f4b42', 'source_volstatus': 'available'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c6b824-a782-40f0-b620-172c5ec4de50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:46 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c6b824-a782-40f0-b620-172c5ec4de50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:46 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0197bbd7-ff33-4f3f-ad51-352d3fcad3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:46 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Volume e08f164d-918b-4b73-b911-f01661b59c5f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e08f164d-918b-4b73-b911-f01661b59c5f', 'volume_size': 1, 'source_volid': '07704e61-0ac4-4a6c-be95-9664625f4b42', 'source_volstatus': 'available'} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:46 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264" returned: 0 in 0.392s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:46 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.info Apr 16 14:43:46 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:46 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.420s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:46 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:47 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.info" returned: 0 in 0.409s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:47 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.info is being set with open permissions: ugo+rw Apr 16 14:43:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:47 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.info Apr 16 14:43:47 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:47 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.info" returned: 0 in 0.397s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.625s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.132s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:47 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Cloning volume 07704e61-0ac4-4a6c-be95-9664625f4b42 to volume e08f164d-918b-4b73-b911-f01661b59c5f Apr 16 14:43:47 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-ca619a38-6834-4fa5-b440-772cad771f5d tempest-CinderUnicodeTest-1891851834 None] Create snapshot completed successfully Apr 16 14:43:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Creating offline snapshot 573f0547-0f6b-453b-b26c-1ec68674cb92 of volume 07704e61-0ac4-4a6c-be95-9664625f4b42 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:43:47 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb5fc30-e41e-463d-bb9a-5366e8a5865e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:47 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 Apr 16 14:43:47 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:48 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42" returned: 0 in 0.437s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:48 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 1G Apr 16 14:43:48 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:48 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 1G" returned: 0 in 0.463s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07704e61-0ac4-4a6c-be95-9664625f4b42 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:48 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07704e61-0ac4-4a6c-be95-9664625f4b42 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 Apr 16 14:43:48 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "cinder-06359e41-fa25-4277-8ef2-0da985733264-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-06359e41-fa25-4277-8ef2-0da985733264-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "cinder-quobyte-204b2e5e-1bc5-4315-8987-2218bf286d42" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-quobyte-204b2e5e-1bc5-4315-8987-2218bf286d42" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "cinder-quobyte-06359e41-fa25-4277-8ef2-0da985733264" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-quobyte-06359e41-fa25-4277-8ef2-0da985733264" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Deleting offline snapshot 06359e41-fa25-4277-8ef2-0da985733264 of volume 204b2e5e-1bc5-4315-8987-2218bf286d42 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] snapshot_file for this snap is: volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aad35f-c602-4660-b5bc-05343a7ffcbf]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:48 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 Apr 16 14:43:48 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:49 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07704e61-0ac4-4a6c-be95-9664625f4b42 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92" returned: 0 in 0.442s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:49 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 is being set with open permissions: ugo+rw Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:49 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 Apr 16 14:43:49 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:49 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264" returned: 0 in 0.464s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-204b2e5e-1bc5-4315-8987-2218bf286d42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4c0c57-575d-44b0-86d9-ccf8c01b8acb]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:49 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 Apr 16 14:43:49 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:49 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92" returned: 0 in 0.400s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:49 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.info Apr 16 14:43:49 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:49 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42" returned: 0 in 0.481s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:49 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 Apr 16 14:43:49 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:49 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.info" returned: 0 in 0.419s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:49 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.info is being set with open permissions: ugo+rw Apr 16 14:43:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:49 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.info Apr 16 14:43:49 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:50 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264" returned: 0 in 0.431s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:50 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264 Apr 16 14:43:50 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:50 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.info" returned: 0 in 0.398s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-quobyte-e08f164d-918b-4b73-b911-f01661b59c5f" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-e08f164d-918b-4b73-b911-f01661b59c5f" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] snapshot: 573f0547-0f6b-453b-b26c-1ec68674cb92, volume: e08f164d-918b-4b73-b911-f01661b59c5f, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb480c43-865e-4cd1-8239-4c78313ce491]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:50 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 Apr 16 14:43:50 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:50 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42.06359e41-fa25-4277-8ef2-0da985733264" returned: 0 in 0.418s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-quobyte-06359e41-fa25-4277-8ef2-0da985733264" released by "_delete_snapshot" :: held 1.845s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-quobyte-204b2e5e-1bc5-4315-8987-2218bf286d42" released by "delete_snapshot" :: held 1.861s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Created reservations ['6e537c62-339f-4ee0-8455-812df925eb6b', '5b687926-02f1-4c2f-af25-1e813871c8c6', '3bad3dc1-0738-4d84-9610-11c6ffe0617d', 'efefd6ba-788a-4047-b6a8-4409fc4aede1'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:50 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Delete snapshot completed successfully. Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1a0249ca-3433-4d50-913e-75a1d4e3f339 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-06359e41-fa25-4277-8ef2-0da985733264-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "cinder-204b2e5e-1bc5-4315-8987-2218bf286d42-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-204b2e5e-1bc5-4315-8987-2218bf286d42-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "cinder-quobyte-204b2e5e-1bc5-4315-8987-2218bf286d42" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-quobyte-204b2e5e-1bc5-4315-8987-2218bf286d42" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f6971e-792a-4efb-8958-96e0924c49d3]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:50 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92" returned: 0 in 0.517s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07704e61-0ac4-4a6c-be95-9664625f4b42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea8033a-f83d-41ea-823d-3b525a3509aa]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:50 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 Apr 16 14:43:50 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:50 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 Apr 16 14:43:50 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:51 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42" returned: 0 in 0.455s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:51 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42 Apr 16 14:43:51 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:51 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42" returned: 0 in 0.478s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:51 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f Apr 16 14:43:51 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:51 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-204b2e5e-1bc5-4315-8987-2218bf286d42" returned: 0 in 0.392s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-quobyte-204b2e5e-1bc5-4315-8987-2218bf286d42" released by "delete_volume" :: held 0.885s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Created reservations ['c88e4833-72cb-4080-96d1-7490539a6f27', 'aa841284-04b9-4537-a1a0-7cfa8308172b', '8f11badf-039f-47d3-9522-ab868fdb7017', '0d58217d-930f-4996-b0f4-873b2c47bceb'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:51 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:51 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "cinder-cf5d63e5-4288-45e4-b48c-337c7deea23a-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-cf5d63e5-4288-45e4-b48c-337c7deea23a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "cinder-quobyte-cf5d63e5-4288-45e4-b48c-337c7deea23a" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-quobyte-cf5d63e5-4288-45e4-b48c-337c7deea23a" acquired by "delete_volume" :: waited 0.029s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:52 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec0e7bb-88ec-4592-8b0d-bd9eec637adf]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:52 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a Apr 16 14:43:52 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:52 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.799s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:52 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:52 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Deleted volume successfully. Apr 16 14:43:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-66dad289-1915-427d-af32-9978cf48b087 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-204b2e5e-1bc5-4315-8987-2218bf286d42-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:53 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f" returned: 0 in 2.045s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7470682-a78a-4ba3-942a-7f1f806d134e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:53 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a" returned: 0 in 1.225s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:53 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a Apr 16 14:43:53 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:53 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 Apr 16 14:43:53 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:53 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf5d63e5-4288-45e4-b48c-337c7deea23a" returned: 0 in 0.426s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-quobyte-cf5d63e5-4288-45e4-b48c-337c7deea23a" released by "delete_volume" :: held 1.703s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Created reservations ['b533b4f0-5b2d-492d-858f-d68eae5247b8', 'ed5e267a-9874-418f-81bb-f67d3c5e8d03', '7d347979-58cb-437d-a9ff-4c5822b95aff', 'e23b78d7-8b1b-4d06-b445-e411794c840c'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:53 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:43:53 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:54 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42" returned: 0 in 0.594s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42, size 1024.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:43:54 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Converted 1024.00 MB image at 500.63 MB/s Apr 16 14:43:54 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f is being set with open permissions: ugo+rw Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:54 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f Apr 16 14:43:54 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:54 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.428s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:43:54 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Deleted volume successfully. Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9c8c63cf-9b59-4150-89dd-3bd6134ea660 tempest-CinderUnicodeTest-1891851834 None] Lock "cinder-cf5d63e5-4288-45e4-b48c-337c7deea23a-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:54 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f" returned: 0 in 0.430s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-e08f164d-918b-4b73-b911-f01661b59c5f" released by "_copy_volume_from_snapshot" :: held 4.105s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-quobyte-573f0547-0f6b-453b-b26c-1ec68674cb92" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-573f0547-0f6b-453b-b26c-1ec68674cb92" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Deleting offline snapshot 573f0547-0f6b-453b-b26c-1ec68674cb92 of volume 07704e61-0ac4-4a6c-be95-9664625f4b42 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] snapshot_file for this snap is: volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3611e174-52d3-4381-bf82-ddfede0defde]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:54 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 Apr 16 14:43:54 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:55 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92" returned: 0 in 0.526s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07704e61-0ac4-4a6c-be95-9664625f4b42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:43:55 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a9e41f-d5d8-43f1-a1ac-dc1ea3ab4fa0]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:55 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 Apr 16 14:43:55 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:55 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42" returned: 0 in 0.470s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:55 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 Apr 16 14:43:55 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:55 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92" returned: 0 in 0.425s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:55 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92 Apr 16 14:43:55 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:56 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42.573f0547-0f6b-453b-b26c-1ec68674cb92" returned: 0 in 0.386s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-573f0547-0f6b-453b-b26c-1ec68674cb92" released by "_delete_snapshot" :: held 1.864s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:43:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.654s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0197bbd7-ff33-4f3f-ad51-352d3fcad3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e08f164d-918b-4b73-b911-f01661b59c5f', 'volume_size': 1, 'source_volid': '07704e61-0ac4-4a6c-be95-9664625f4b42', 'source_volstatus': 'available'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf6998c-3566-4e27-b073-fcfc454584fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:56 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Volume volume-e08f164d-918b-4b73-b911-f01661b59c5f (e08f164d-918b-4b73-b911-f01661b59c5f): created successfully Apr 16 14:43:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf6998c-3566-4e27-b073-fcfc454584fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:56 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (4a1f7f31-970a-4d0f-9310-a9e64c28def0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:56 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e2cfdbeb-1049-4376-8707-f57a363005c8 tempest-VolumesGetTest-1134503723 None] Created volume successfully. Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (ef90b999-5811-4d4d-93fd-43dd7b6c1761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e372ff-066a-4bc3-97d0-8cb64730f7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e372ff-066a-4bc3-97d0-8cb64730f7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1137786790',display_name='tempest-VolumesGetTest-Volume-1236316123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e81c927-d01a-45a8-9185-f9118c5b5262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:57Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972cbb21-e4bc-4ed8-a6dd-56df9ffe705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972cbb21-e4bc-4ed8-a6dd-56df9ffe705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac488a00-ad7f-45e3-9818-6dbef30d8b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac488a00-ad7f-45e3-9818-6dbef30d8b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e81c927-d01a-45a8-9185-f9118c5b5262', 'volume_name': 'volume-0e81c927-d01a-45a8-9185-f9118c5b5262', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1bc30be-42a5-437f-84d2-87d260ba69f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1bc30be-42a5-437f-84d2-87d260ba69f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9216b150-9a17-43cd-808f-a39b7318bb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:57 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Volume 0e81c927-d01a-45a8-9185-f9118c5b5262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e81c927-d01a-45a8-9185-f9118c5b5262', 'volume_size': 1} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:43:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1137786790',display_name='tempest-VolumesGetTest-Volume-1236316123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e81c927-d01a-45a8-9185-f9118c5b5262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:43:57Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Creating volume 0e81c927-d01a-45a8-9185-f9118c5b5262 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:43:57 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:57 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262 1073741824 Apr 16 14:43:57 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:57 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262 1073741824" returned: 0 in 0.475s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:57 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262 Apr 16 14:43:57 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:43:58 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 16 14:43:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262" returned: 0 in 0.413s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:43:58 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:43:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:43:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9216b150-9a17-43cd-808f-a39b7318bb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e81c927-d01a-45a8-9185-f9118c5b5262', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b104a49f-a1b9-4c11-bd05-d8da9c75e9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:43:58 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Volume volume-0e81c927-d01a-45a8-9185-f9118c5b5262 (0e81c927-d01a-45a8-9185-f9118c5b5262): created successfully Apr 16 14:43:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b104a49f-a1b9-4c11-bd05-d8da9c75e9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:43:58 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (ef90b999-5811-4d4d-93fd-43dd7b6c1761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:43:58 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-621f135a-eda3-494d-b181-f95c1fdb5064 tempest-VolumesGetTest-1134503723 None] Created volume successfully. Apr 16 14:43:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-0e81c927-d01a-45a8-9185-f9118c5b5262-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Lock "cinder-0e81c927-d01a-45a8-9185-f9118c5b5262-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-quobyte-0e81c927-d01a-45a8-9185-f9118c5b5262" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:43:59 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-0e81c927-d01a-45a8-9185-f9118c5b5262" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:43:59 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[687df267-dbcf-44d8-9081-19969ce5dc14]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:43:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:43:59 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262 Apr 16 14:43:59 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:00 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262" returned: 0 in 0.439s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:00 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262 Apr 16 14:44:00 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:00 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0e81c927-d01a-45a8-9185-f9118c5b5262" returned: 0 in 0.386s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-0e81c927-d01a-45a8-9185-f9118c5b5262" released by "delete_volume" :: held 0.847s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Created reservations ['7160edba-06a8-461a-90b5-8221d2f123af', '0ae0bbd0-cbab-47d5-be41-004435c85563', '69038dbc-2f2f-4821-ab80-5e580fd10b78', '1b8a74dc-626f-4cd0-8bb4-1777ad6960e5'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:00 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:00 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-e08f164d-918b-4b73-b911-f01661b59c5f-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Lock "cinder-e08f164d-918b-4b73-b911-f01661b59c5f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-quobyte-e08f164d-918b-4b73-b911-f01661b59c5f" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-e08f164d-918b-4b73-b911-f01661b59c5f" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[af39ea2a-f6bd-4fb0-838d-c4d40b3e94fe]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:00 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f Apr 16 14:44:00 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:01 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.406s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:01 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Deleted volume successfully. Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6262d69c-6b82-4a16-b200-57dfb419ae60 tempest-VolumesGetTest-1134503723 None] Lock "cinder-0e81c927-d01a-45a8-9185-f9118c5b5262-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:01 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f" returned: 0 in 0.456s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:01 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f Apr 16 14:44:01 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:01 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-e08f164d-918b-4b73-b911-f01661b59c5f" returned: 0 in 0.401s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-e08f164d-918b-4b73-b911-f01661b59c5f" released by "delete_volume" :: held 0.876s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Created reservations ['2dcb704c-3569-4326-b9e4-8fabda758571', '48c21040-9439-43d7-b881-cb0cf148f6f3', 'faddfb04-1462-4da7-97f2-ca4148398c32', '17822780-152d-4fec-8472-5061717e0898'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:01 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:01 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-07704e61-0ac4-4a6c-be95-9664625f4b42-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Lock "cinder-07704e61-0ac4-4a6c-be95-9664625f4b42-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-quobyte-07704e61-0ac4-4a6c-be95-9664625f4b42" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-07704e61-0ac4-4a6c-be95-9664625f4b42" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eca6cf0-6c46-47bb-8bf5-6320eceb9f01]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:02 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 Apr 16 14:44:02 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:02 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.450s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:02 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Deleted volume successfully. Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-eea0072e-ae9d-43be-b4d8-f890ff2dbf23 tempest-VolumesGetTest-1134503723 None] Lock "cinder-e08f164d-918b-4b73-b911-f01661b59c5f-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:02 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42" returned: 0 in 0.471s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:02 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42 Apr 16 14:44:02 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:02 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-07704e61-0ac4-4a6c-be95-9664625f4b42" returned: 0 in 0.420s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-07704e61-0ac4-4a6c-be95-9664625f4b42" released by "delete_volume" :: held 0.919s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Created reservations ['bddcfe64-8523-4e7c-adfd-aa8f0346ae47', 'baef4c87-9d75-4304-8472-9860daebb25f', '16fb6b26-9765-4519-9507-1016a37db137', '2bfa522f-d2dc-45bb-b1f1-4fa18dcc9702'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:02 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:02 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:44:03 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (2df6d9c7-712c-4196-850f-6aac7707f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e26d07-e273-49ff-ac86-071b931277c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.444s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:03 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Deleted volume successfully. Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e26d07-e273-49ff-ac86-071b931277c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1436462348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06c16e5-fb78-43a6-a8a4-06ef1d3552a5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:03Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11779157-ee75-445d-b1f7-1ebbdf02c3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11779157-ee75-445d-b1f7-1ebbdf02c3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6c254a-f962-47d3-ae3f-da59e5e2fbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.image.glance [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Creating Keystone auth plugin from conf {{(pid=83305) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9df338f0-7a3c-4bcd-88c0-1c88ace71a7a tempest-VolumesGetTest-1134503723 None] Lock "cinder-07704e61-0ac4-4a6c-be95-9664625f4b42-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6c254a-f962-47d3-ae3f-da59e5e2fbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a06c16e5-fb78-43a6-a8a4-06ef1d3552a5', 'volume_name': 'volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afb75e7-bf79-42bb-a83b-f094f9e810b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afb75e7-bf79-42bb-a83b-f094f9e810b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cff45f-194e-4309-8226-0021b31dc24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:03 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Volume a06c16e5-fb78-43a6-a8a4-06ef1d3552a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Trying to clone a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 from image a03b4007-0186-44e1-a560-91d8e58559a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]). {{(pid=83305) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 14:44:03 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Image download 20.69 MB at 20.69 MB/s Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bab707-027b-4c66-ae33-d4163b61df99]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:03 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD Apr 16 14:44:03 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:04 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Temporary image a03b4007-0186-44e1-a560-91d8e58559a1 is fetched for user 1c2503a4d9bf44ec92df4ed0a5042b1b. {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c3d6c8-7b2c-40e1-baa9-445dd7e0407c]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:04 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD Apr 16 14:44:04 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:04 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1436462348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06c16e5-fb78-43a6-a8a4-06ef1d3552a5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:03Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Creating volume a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:44:04 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:44:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:04 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 1073741824 Apr 16 14:44:04 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:05 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 1073741824" returned: 0 in 0.451s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:05 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 Apr 16 14:44:05 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:05 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5" returned: 0 in 0.389s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:44:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:05 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Attempting download of a03b4007-0186-44e1-a560-91d8e58559a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}])) to volume a06c16e5-fb78-43a6-a8a4-06ef1d3552a5. {{(pid=83305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 14:44:05 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8cfe54-79fd-46b6-9c97-1f6564d218c3]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_kpdmbd7z {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:05 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_kpdmbd7z Apr 16 14:44:05 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:06 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_kpdmbd7z" returned: 0 in 0.438s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_kpdmbd7z {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:06 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_kpdmbd7z Apr 16 14:44:06 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:06 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_kpdmbd7z" returned: 1 in 0.431s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03b4007-0186-44e1-a560-91d8e58559a1_kpdmbd7z' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:44:06 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac52ae9-e24e-48c9-9275-fd2401ce3af0]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:06 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD Apr 16 14:44:06 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:07 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:07 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] a03b4007-0186-44e1-a560-91d8e58559a1 was qcow2, converting to raw {{(pid=83305) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 14:44:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:07 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 Apr 16 14:44:07 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:07 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5" returned: 0 in 0.815s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:07 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a03b4007-0186-44e1-a560-91d8e58559a1_z51v2xdfdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:44:07 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Converted 112.00 MB image at 112.00 MB/s Apr 16 14:44:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:07 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 1G Apr 16 14:44:07 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:08 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 1G" returned: 0 in 0.402s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:08 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f573092d-ecc3-4909-a6f5-b17b537bb7be]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:08 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 Apr 16 14:44:08 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:08 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5" returned: 0 in 0.445s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:08 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 Apr 16 14:44:08 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:09 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5" returned: 1 in 0.439s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:44:09 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Downloaded image a03b4007-0186-44e1-a560-91d8e58559a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}])) to volume a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 successfully. {{(pid=83305) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 14:44:09 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Temporary image a03b4007-0186-44e1-a560-91d8e58559a1 for user 1c2503a4d9bf44ec92df4ed0a5042b1b is deleted. {{(pid=83305) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 14:44:09 devstack cinder-volume[83305]: DEBUG cinder.volume.volume_utils [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Marking volume a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 as bootable. {{(pid=83305) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 14:44:09 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Copying metadata from image a03b4007-0186-44e1-a560-91d8e58559a1 to a06c16e5-fb78-43a6-a8a4-06ef1d3552a5. {{(pid=83305) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 14:44:09 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Creating volume glance metadata for volume a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 backed by image a03b4007-0186-44e1-a560-91d8e58559a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83305) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 14:44:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cff45f-194e-4309-8226-0021b31dc24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5', 'volume_size': 1, 'image_id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03b4007-0186-44e1-a560-91d8e58559a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4c04ca025f4847e18e0e586b20969450', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a03b4007-0186-44e1-a560-91d8e58559a1', 'created_at': datetime.datetime(2026, 4, 16, 12, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 12, 31, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03b4007-0186-44e1-a560-91d8e58559a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3edd4e-fb4d-4783-a72e-5a47ace85564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:09 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Volume volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 (a06c16e5-fb78-43a6-a8a4-06ef1d3552a5): created successfully Apr 16 14:44:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3edd4e-fb4d-4783-a72e-5a47ace85564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (2df6d9c7-712c-4196-850f-6aac7707f836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:09 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-fc81ec63-e6d4-48e6-bc98-d336d0dd0d2c tempest-VolumesGetTest-1134503723 None] Created volume successfully. Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (fa7344a4-9c83-4b83-917d-5bac36cc118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c8157e-e5be-44d4-9684-c0126a55b1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c8157e-e5be-44d4-9684-c0126a55b1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1634865735',display_name='tempest-VolumesGetTest-Volume-506452583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f7c4b8-1167-4005-a01a-301179ef30dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:10Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68cf05d-ee8b-419a-a2a7-a5ad36d27c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68cf05d-ee8b-419a-a2a7-a5ad36d27c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6df95d6-ec22-483e-8a93-bb037f9b1e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6df95d6-ec22-483e-8a93-bb037f9b1e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f7c4b8-1167-4005-a01a-301179ef30dd', 'volume_name': 'volume-51f7c4b8-1167-4005-a01a-301179ef30dd', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e03b181-fd18-4c56-8faf-2e35769f8fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e03b181-fd18-4c56-8faf-2e35769f8fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4184aedd-f7b2-49d3-ae5b-8b8f3081177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:10 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Volume 51f7c4b8-1167-4005-a01a-301179ef30dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f7c4b8-1167-4005-a01a-301179ef30dd', 'volume_size': 1} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1634865735',display_name='tempest-VolumesGetTest-Volume-506452583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f7c4b8-1167-4005-a01a-301179ef30dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63eac76a53b41eda29b47cb79323a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:10Z,use_quota=True,user_id='1c2503a4d9bf44ec92df4ed0a5042b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Creating volume 51f7c4b8-1167-4005-a01a-301179ef30dd {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:44:10 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:10 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd 1073741824 Apr 16 14:44:10 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:10 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd 1073741824" returned: 0 in 0.472s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:10 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd Apr 16 14:44:10 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:10 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd" returned: 0 in 0.385s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:44:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4184aedd-f7b2-49d3-ae5b-8b8f3081177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f7c4b8-1167-4005-a01a-301179ef30dd', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53b5125-5144-49e2-a765-560e01ed804f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:11 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Volume volume-51f7c4b8-1167-4005-a01a-301179ef30dd (51f7c4b8-1167-4005-a01a-301179ef30dd): created successfully Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53b5125-5144-49e2-a765-560e01ed804f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Flow 'volume_create_manager' (fa7344a4-9c83-4b83-917d-5bac36cc118c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:11 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-8a446719-bf81-4b1a-ba63-b23da4eb77ff tempest-VolumesGetTest-1134503723 None] Created volume successfully. Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-51f7c4b8-1167-4005-a01a-301179ef30dd-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Lock "cinder-51f7c4b8-1167-4005-a01a-301179ef30dd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-quobyte-51f7c4b8-1167-4005-a01a-301179ef30dd" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-51f7c4b8-1167-4005-a01a-301179ef30dd" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb78e94-428d-4898-95c1-0c31df8f667e]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:11 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd Apr 16 14:44:11 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:11 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd" returned: 0 in 0.462s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:11 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd Apr 16 14:44:11 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:12 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-51f7c4b8-1167-4005-a01a-301179ef30dd" returned: 0 in 0.388s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-51f7c4b8-1167-4005-a01a-301179ef30dd" released by "delete_volume" :: held 0.875s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:UPDATE=220,cinder:SELECT=158,cinder:DELETE=20,cinder:INSERT=51 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Created reservations ['6bb365cd-b16d-40b8-ae98-8b222265e3bc', '5825e10a-a9e9-4d19-8530-a332356bbea2', '4afd71c2-d73b-48d4-a94e-51ec69ed0198', '04a6c41b-b6fd-4ace-a866-519994949d68'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:12 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:12 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Lock "cinder-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Acquiring lock "cinder-quobyte-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5" acquired by "delete_volume" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66353e1-e393-49dc-99d3-c0028f481e83]: (4, 'raw') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:12 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 Apr 16 14:44:12 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:12 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.457s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:12 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Deleted volume successfully. Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-0397f5bc-bb0c-417f-8ff6-657945555355 tempest-VolumesGetTest-1134503723 None] Lock "cinder-51f7c4b8-1167-4005-a01a-301179ef30dd-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:12 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5" returned: 0 in 0.456s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:12 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 Apr 16 14:44:12 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:13 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5" returned: 1 in 0.448s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5' failed. Not Retrying. {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:13 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5 Apr 16 14:44:13 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:13 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5" returned: 0 in 0.396s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Lock "cinder-quobyte-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5" released by "delete_volume" :: held 1.344s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:UPDATE=234,cinder:SELECT=174,cinder:INSERT=70,cinder:DELETE=18 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Created reservations ['5021ceb3-63d8-4d4b-b175-611ab76f3e26', 'a60d68f5-7d6b-4049-b76e-95cfb91f3289', '8c0d4e86-ff2e-4b0b-9be4-e621e2bf369a', 'd70889bb-681d-4a80-8bd7-c90f9bce5a97'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:13 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:13 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:14 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.388s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:14 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:14 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Deleted volume successfully. Apr 16 14:44:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5b20255-8a4b-4e41-a708-426eadab93b6 tempest-VolumesGetTest-1134503723 None] Lock "cinder-a06c16e5-fb78-43a6-a8a4-06ef1d3552a5-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Flow 'volume_create_manager' (c1c9f94c-71b6-4a59-90eb-42afe85db2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c739db87-fcf5-4743-9966-8eaa2790fbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c739db87-fcf5-4743-9966-8eaa2790fbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-658276004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75fb0c0-ab52-433b-91b5-bd49c323c417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17fff5b1b9c9439687aa4f0d3d70c306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:16Z,use_quota=True,user_id='8b1e77abe24946adaf9f572702c0cb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addcb9b8-491e-4036-a6cc-6a67ee17ac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addcb9b8-491e-4036-a6cc-6a67ee17ac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189777b5-67f0-4514-8bed-dd72ce472ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189777b5-67f0-4514-8bed-dd72ce472ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c75fb0c0-ab52-433b-91b5-bd49c323c417', 'volume_name': 'volume-c75fb0c0-ab52-433b-91b5-bd49c323c417', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5114993e-a70c-430d-b899-c6d75dcf69f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5114993e-a70c-430d-b899-c6d75dcf69f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8daa327b-2a22-4c43-85d1-53b7de2ed23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:16 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Volume c75fb0c0-ab52-433b-91b5-bd49c323c417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c75fb0c0-ab52-433b-91b5-bd49c323c417', 'volume_size': 1} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-658276004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75fb0c0-ab52-433b-91b5-bd49c323c417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17fff5b1b9c9439687aa4f0d3d70c306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:16Z,use_quota=True,user_id='8b1e77abe24946adaf9f572702c0cb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Creating volume c75fb0c0-ab52-433b-91b5-bd49c323c417 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:44:16 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:16 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417 1073741824 Apr 16 14:44:16 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:16 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417 1073741824" returned: 0 in 0.449s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:16 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417 Apr 16 14:44:16 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:16 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417" returned: 0 in 0.405s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:17 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:44:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8daa327b-2a22-4c43-85d1-53b7de2ed23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75fb0c0-ab52-433b-91b5-bd49c323c417', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68ffd6b-98e8-4ee2-9f8c-d483532c8a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:17 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Volume volume-c75fb0c0-ab52-433b-91b5-bd49c323c417 (c75fb0c0-ab52-433b-91b5-bd49c323c417): created successfully Apr 16 14:44:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68ffd6b-98e8-4ee2-9f8c-d483532c8a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Flow 'volume_create_manager' (c1c9f94c-71b6-4a59-90eb-42afe85db2eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:17 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e26d0d17-7ef4-48cc-84cd-d76ea3c4a207 tempest-VolumesNegativeTest-1273250036 None] Created volume successfully. Apr 16 14:44:27 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:INSERT=3,cinder:UPDATE=8,cinder:SELECT=3,cinder:DELETE=1 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:44:27 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:UPDATE=20,cinder:SELECT=10,cinder:DELETE=2,cinder:INSERT=2 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:44:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Acquiring lock "cinder-c75fb0c0-ab52-433b-91b5-bd49c323c417-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Lock "cinder-c75fb0c0-ab52-433b-91b5-bd49c323c417-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Acquiring lock "cinder-quobyte-c75fb0c0-ab52-433b-91b5-bd49c323c417" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Lock "cinder-quobyte-c75fb0c0-ab52-433b-91b5-bd49c323c417" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:39 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0fff8d-858f-4d4d-81da-c68015dcd9ca]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:39 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417 Apr 16 14:44:39 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:40 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417" returned: 0 in 0.438s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:40 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417 Apr 16 14:44:40 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:40 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-c75fb0c0-ab52-433b-91b5-bd49c323c417" returned: 0 in 0.385s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Lock "cinder-quobyte-c75fb0c0-ab52-433b-91b5-bd49c323c417" released by "delete_volume" :: held 0.843s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:40 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Created reservations ['146ce15f-1050-4814-8a06-a7167b0bf8d8', '1db5252e-c8a6-42b5-adeb-9a5ae82fe8a9', '5083b723-d235-4752-9c7a-3165ad2f0165', '5b6a2c3c-b474-47f0-9e0c-cfc37d702141'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:40 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:40 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:41 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.459s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:41 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:41 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Deleted volume successfully. Apr 16 14:44:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-423a468c-60d6-4c9d-b397-7c7648a0cb37 tempest-VolumesNegativeTest-1273250036 None] Lock "cinder-c75fb0c0-ab52-433b-91b5-bd49c323c417-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (a299c0a1-d0de-403f-ae91-74772f5153e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e75595-5c32-4e88-a78b-d3f98ead4d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e75595-5c32-4e88-a78b-d3f98ead4d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-783924427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd994800-1fc5-44ad-8277-be09e974f990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:42Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30650a35-edf9-41fa-9e70-73cab45866c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30650a35-edf9-41fa-9e70-73cab45866c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda1ea02-36a5-4941-a8ee-718600923064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda1ea02-36a5-4941-a8ee-718600923064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd994800-1fc5-44ad-8277-be09e974f990', 'volume_name': 'volume-dd994800-1fc5-44ad-8277-be09e974f990', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda16daf-a8a1-44cc-a197-343692907e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda16daf-a8a1-44cc-a197-343692907e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc201ba-0593-4ca1-8d45-8168fb2d9f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:42 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume dd994800-1fc5-44ad-8277-be09e974f990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd994800-1fc5-44ad-8277-be09e974f990', 'volume_size': 1} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-783924427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd994800-1fc5-44ad-8277-be09e974f990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:42Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Creating volume dd994800-1fc5-44ad-8277-be09e974f990 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:44:42 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:42 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990 1073741824 Apr 16 14:44:42 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:42 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990 1073741824" returned: 0 in 0.468s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:42 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990 Apr 16 14:44:42 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:43 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990" returned: 0 in 0.416s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc201ba-0593-4ca1-8d45-8168fb2d9f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd994800-1fc5-44ad-8277-be09e974f990', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43b6827-9e86-4984-af92-3ce15471f9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:43 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume volume-dd994800-1fc5-44ad-8277-be09e974f990 (dd994800-1fc5-44ad-8277-be09e974f990): created successfully Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43b6827-9e86-4984-af92-3ce15471f9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (a299c0a1-d0de-403f-ae91-74772f5153e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:43 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-3863caef-7371-4daa-af91-0e77a0f4dac7 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created volume successfully. Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (337e790e-593b-4f05-954e-5ab031801c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26d7f16-e458-4439-a168-074643be6683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26d7f16-e458-4439-a168-074643be6683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-463784816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e06d55-5ea6-4974-839f-af3d273be122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:44Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be04b2a-82ab-4d65-a668-5dec3e89ed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be04b2a-82ab-4d65-a668-5dec3e89ed50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815e63c4-20de-47c2-a534-ae450822230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815e63c4-20de-47c2-a534-ae450822230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46e06d55-5ea6-4974-839f-af3d273be122', 'volume_name': 'volume-46e06d55-5ea6-4974-839f-af3d273be122', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d551bc1-a0f8-4f1b-957e-9c498898076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d551bc1-a0f8-4f1b-957e-9c498898076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1588e8-fbf1-46e6-843d-33c5517eeb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:43 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume 46e06d55-5ea6-4974-839f-af3d273be122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46e06d55-5ea6-4974-839f-af3d273be122', 'volume_size': 1} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-463784816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e06d55-5ea6-4974-839f-af3d273be122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:44Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Creating volume 46e06d55-5ea6-4974-839f-af3d273be122 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:44:43 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:43 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122 1073741824 Apr 16 14:44:43 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (c03bab11-99f3-4905-b07d-003a41427c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b814ebb-813c-488c-9a04-05f3a82d7709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b814ebb-813c-488c-9a04-05f3a82d7709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215878062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffef393-b7d8-4b0c-aa05-74d81bf45e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:44Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bc87e7-1c67-406f-9bd5-fde19d894e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bc87e7-1c67-406f-9bd5-fde19d894e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fab90e-8e73-483c-8065-c172f588470c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:43 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fab90e-8e73-483c-8065-c172f588470c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fffef393-b7d8-4b0c-aa05-74d81bf45e98', 'volume_name': 'volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97264054-829e-4704-971b-85a3b51d36a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97264054-829e-4704-971b-85a3b51d36a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443e2fff-6d22-4814-8ec6-6169f80fb429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume fffef393-b7d8-4b0c-aa05-74d81bf45e98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98', 'volume_size': 1} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (dd5caf38-40e3-4d7f-b061-54043d0a9ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ffbb2-703a-44d1-b923-af986fa836d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ffbb2-703a-44d1-b923-af986fa836d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-733309754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78682fa3-ce5e-475d-bde6-aa5cf334db9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:44Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a612ab-0ff8-42b2-8748-c01117c39b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a612ab-0ff8-42b2-8748-c01117c39b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5336a3-9c12-4177-831f-c41e6aecfebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5336a3-9c12-4177-831f-c41e6aecfebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78682fa3-ce5e-475d-bde6-aa5cf334db9e', 'volume_name': 'volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69693f3-034f-4991-9d3a-ffa1e8732d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69693f3-034f-4991-9d3a-ffa1e8732d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40f772a-5a57-4fd9-b53b-b469bac1743e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume 78682fa3-ce5e-475d-bde6-aa5cf334db9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e', 'volume_size': 1} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (ba636fda-fb50-4c75-ae4c-65b7fa078f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9657b434-3d54-4549-8a9d-fb7711e6528c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9657b434-3d54-4549-8a9d-fb7711e6528c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1883743101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4011a0cb-d90d-4c49-b7bc-5dd34b615834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:44Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d7a393-1eec-401d-8ccf-4b9daed7d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d7a393-1eec-401d-8ccf-4b9daed7d305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f1d1cd-2397-44cb-96fe-f50caf9e3925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f1d1cd-2397-44cb-96fe-f50caf9e3925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4011a0cb-d90d-4c49-b7bc-5dd34b615834', 'volume_name': 'volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5675293-3de7-42eb-902d-429d590cba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5675293-3de7-42eb-902d-429d590cba96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafe5a8f-24cc-4468-9f4e-a8eb8f0da139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume 4011a0cb-d90d-4c49-b7bc-5dd34b615834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834', 'volume_size': 1} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122 1073741824" returned: 0 in 0.606s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:44 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122 Apr 16 14:44:44 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (45899c9a-0e51-4991-b377-66ba81acc65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55475fe-65ee-4ded-ae98-4226ef54d143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55475fe-65ee-4ded-ae98-4226ef54d143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-399626762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4b878e-9d15-4bf8-bd1a-0ec51476efb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:44Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37d5a43-1a22-4866-ab14-1839b4d62934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37d5a43-1a22-4866-ab14-1839b4d62934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748141bb-72e1-4739-bdf5-46edb6b7c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748141bb-72e1-4739-bdf5-46edb6b7c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4b878e-9d15-4bf8-bd1a-0ec51476efb8', 'volume_name': 'volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f8b182-0e57-40ec-8497-ce83e8152662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f8b182-0e57-40ec-8497-ce83e8152662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720188d7-96ae-49f1-bf9b-a4cc1f1efd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume 6c4b878e-9d15-4bf8-bd1a-0ec51476efb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8', 'volume_size': 1} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:44 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122" returned: 0 in 0.395s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.819s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215878062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffef393-b7d8-4b0c-aa05-74d81bf45e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:44Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Creating volume fffef393-b7d8-4b0c-aa05-74d81bf45e98 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:44:44 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:44 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98 1073741824 Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1588e8-fbf1-46e6-843d-33c5517eeb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e06d55-5ea6-4974-839f-af3d273be122', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d2691e-60c2-49c4-8cb7-ca52e703da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:44 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume volume-46e06d55-5ea6-4974-839f-af3d273be122 (46e06d55-5ea6-4974-839f-af3d273be122): created successfully Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d2691e-60c2-49c4-8cb7-ca52e703da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:44 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (337e790e-593b-4f05-954e-5ab031801c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:44 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e7662ce7-5b34-4378-9e6c-99cace0d4b49 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created volume successfully. Apr 16 14:44:45 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98 1073741824" returned: 0 in 0.462s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:45 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98 Apr 16 14:44:45 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:45 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98" returned: 0 in 0.425s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-733309754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78682fa3-ce5e-475d-bde6-aa5cf334db9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:44Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Creating volume 78682fa3-ce5e-475d-bde6-aa5cf334db9e {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:44:45 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443e2fff-6d22-4814-8ec6-6169f80fb429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:45 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e 1073741824 Apr 16 14:44:45 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db0654a-c04e-4f32-8927-08da612e7002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:45 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98 (fffef393-b7d8-4b0c-aa05-74d81bf45e98): created successfully Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db0654a-c04e-4f32-8927-08da612e7002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:45 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (c03bab11-99f3-4905-b07d-003a41427c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:45 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-612ed061-b19e-4dd2-a73b-3fb4640f1515 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created volume successfully. Apr 16 14:44:46 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e 1073741824" returned: 0 in 0.442s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:46 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e Apr 16 14:44:46 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_service.periodic_task [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:46 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:46 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:46 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e" returned: 0 in 0.406s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.203s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1883743101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4011a0cb-d90d-4c49-b7bc-5dd34b615834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:44Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Creating volume 4011a0cb-d90d-4c49-b7bc-5dd34b615834 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:44:46 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40f772a-5a57-4fd9-b53b-b469bac1743e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:46 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834 1073741824 Apr 16 14:44:46 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcab9ac-e6ee-46c7-b2ab-f2a1c2330edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:46 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e (78682fa3-ce5e-475d-bde6-aa5cf334db9e): created successfully Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcab9ac-e6ee-46c7-b2ab-f2a1c2330edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (dd5caf38-40e3-4d7f-b061-54043d0a9ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:46 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-29aeae9b-b231-4864-97ad-b95d5d5d65c8 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created volume successfully. Apr 16 14:44:46 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.450s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:46 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:47 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834 1073741824" returned: 0 in 0.452s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:47 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834 Apr 16 14:44:47 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:47 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834" returned: 0 in 0.407s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.976s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-399626762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4b878e-9d15-4bf8-bd1a-0ec51476efb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce296bbe60244096979c8d7e25452373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:44:44Z,use_quota=True,user_id='1bb4edbe4bf54bd0ad4680be333517ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Creating volume 6c4b878e-9d15-4bf8-bd1a-0ec51476efb8 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:44:47 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafe5a8f-24cc-4468-9f4e-a8eb8f0da139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:47 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8 1073741824 Apr 16 14:44:47 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991ac71e-e8e3-4a5b-83e9-1fcd8b2b1a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:47 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834 (4011a0cb-d90d-4c49-b7bc-5dd34b615834): created successfully Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991ac71e-e8e3-4a5b-83e9-1fcd8b2b1a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (ba636fda-fb50-4c75-ae4c-65b7fa078f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:47 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-648e78ed-9fad-41b6-90c8-d51fb59dcc9e tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created volume successfully. Apr 16 14:44:47 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8 1073741824" returned: 0 in 0.471s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:48 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8 Apr 16 14:44:48 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:48 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8" returned: 0 in 0.412s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720188d7-96ae-49f1-bf9b-a4cc1f1efd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9fced3-b4d7-4e9f-a225-ad853f4a0c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:44:48 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Volume volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8 (6c4b878e-9d15-4bf8-bd1a-0ec51476efb8): created successfully Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9fced3-b4d7-4e9f-a225-ad853f4a0c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Flow 'volume_create_manager' (45899c9a-0e51-4991-b377-66ba81acc65f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:44:48 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-3a715ddb-da90-4071-bfd9-8a182b78b5c1 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created volume successfully. Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-quobyte-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e3a09-3e8a-4b0d-85b9-9a9dc36dc7ad]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:48 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8 Apr 16 14:44:48 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:49 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8" returned: 0 in 0.441s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:49 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8 Apr 16 14:44:49 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:49 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8" returned: 0 in 0.382s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8" released by "delete_volume" :: held 0.844s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created reservations ['59125b1f-127f-413c-834b-64dddf8076a9', '3a99b4bf-6837-41c6-9279-430bb7851da0', 'a1d44c65-bf67-4420-a856-1e0ebcb667e3', '00c914e5-4486-45c8-a8ce-221b117565b8'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:49 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:49 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:49 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-4011a0cb-d90d-4c49-b7bc-5dd34b615834-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-4011a0cb-d90d-4c49-b7bc-5dd34b615834-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-quobyte-4011a0cb-d90d-4c49-b7bc-5dd34b615834" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-4011a0cb-d90d-4c49-b7bc-5dd34b615834" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[be92906c-8c66-4943-a87d-f7d370b1bce7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:50 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834 Apr 16 14:44:50 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:50 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.405s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:50 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Deleted volume successfully. Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-7849eda2-c96e-42ca-8def-0731c4b559ca tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-6c4b878e-9d15-4bf8-bd1a-0ec51476efb8-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:50 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834" returned: 0 in 0.447s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:50 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834 Apr 16 14:44:50 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:50 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4011a0cb-d90d-4c49-b7bc-5dd34b615834" returned: 0 in 0.387s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-4011a0cb-d90d-4c49-b7bc-5dd34b615834" released by "delete_volume" :: held 0.853s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created reservations ['bdc5f982-caf6-4a44-a481-08c0c52ce318', 'beaca134-b46d-4637-adc4-efd6cd30df17', '8eb4d40d-0864-404b-ae85-d4d7ae964df7', '650e1c1b-4665-49a1-8d72-e47031001ce2'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:50 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:50 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-78682fa3-ce5e-475d-bde6-aa5cf334db9e-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-78682fa3-ce5e-475d-bde6-aa5cf334db9e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-quobyte-78682fa3-ce5e-475d-bde6-aa5cf334db9e" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-78682fa3-ce5e-475d-bde6-aa5cf334db9e" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:51 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbdd9ab-1c5b-497f-b6ed-b80848b881ff]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:51 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e Apr 16 14:44:51 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:51 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.421s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:51 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:51 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Deleted volume successfully. Apr 16 14:44:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1cf686fd-6925-4301-a415-48ae5406ae8a tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-4011a0cb-d90d-4c49-b7bc-5dd34b615834-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:51 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e" returned: 0 in 0.452s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:51 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e Apr 16 14:44:51 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:52 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-78682fa3-ce5e-475d-bde6-aa5cf334db9e" returned: 0 in 0.393s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-78682fa3-ce5e-475d-bde6-aa5cf334db9e" released by "delete_volume" :: held 0.874s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created reservations ['689b1fdc-a5a3-4afe-bd4e-3acb782a37d8', '31eb518e-7fe5-43f3-b449-6954ce53790e', '6898b64a-2454-4b09-b9c9-f4978b9c7dec', '2f787ba5-4ca6-4ed5-815a-5b23e213c61f'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:52 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:52 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-fffef393-b7d8-4b0c-aa05-74d81bf45e98-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-fffef393-b7d8-4b0c-aa05-74d81bf45e98-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-quobyte-fffef393-b7d8-4b0c-aa05-74d81bf45e98" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-fffef393-b7d8-4b0c-aa05-74d81bf45e98" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5e2f0f-cdae-4687-98fe-f9a1ad8970ea]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:52 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98 Apr 16 14:44:52 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:52 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.411s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:52 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Deleted volume successfully. Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b5d2188c-8d57-4a6d-b8bc-5407868bdddd tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-78682fa3-ce5e-475d-bde6-aa5cf334db9e-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:52 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98" returned: 0 in 0.482s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:52 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98 Apr 16 14:44:52 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:53 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fffef393-b7d8-4b0c-aa05-74d81bf45e98" returned: 0 in 0.386s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-fffef393-b7d8-4b0c-aa05-74d81bf45e98" released by "delete_volume" :: held 0.890s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created reservations ['cf29b29e-6ad0-455e-b229-dd688ca9d2bf', '8d111b21-6a4d-42b5-a996-208dc0d78a59', '19713279-f740-4fb2-bcbe-9dc907e1a4c4', 'd2b82216-1119-4c2b-819c-61d5de9ebfb7'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:53 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:53 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-46e06d55-5ea6-4974-839f-af3d273be122-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-46e06d55-5ea6-4974-839f-af3d273be122-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-quobyte-46e06d55-5ea6-4974-839f-af3d273be122" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-46e06d55-5ea6-4974-839f-af3d273be122" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef6a5a-7ce2-4b43-a209-18c56d06c204]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:53 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122 Apr 16 14:44:53 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:53 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.416s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:53 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Deleted volume successfully. Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58ffaf93-0782-4a53-931e-e5d5bf7d4d68 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-fffef393-b7d8-4b0c-aa05-74d81bf45e98-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:53 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122" returned: 0 in 0.449s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:53 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122 Apr 16 14:44:53 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:54 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46e06d55-5ea6-4974-839f-af3d273be122" returned: 0 in 0.386s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-46e06d55-5ea6-4974-839f-af3d273be122" released by "delete_volume" :: held 0.864s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created reservations ['4c5cd2e6-b3ce-47ad-821e-c95bc8bee3ca', '9a2375c8-f0a8-4283-a080-eed16004d541', '7d566ae1-d725-4ed9-a92f-76af89cdb696', 'eb2711f9-37d5-4aff-82ab-35e9dae231de'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:54 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:54 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-dd994800-1fc5-44ad-8277-be09e974f990-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-dd994800-1fc5-44ad-8277-be09e974f990-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "cinder-quobyte-dd994800-1fc5-44ad-8277-be09e974f990" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-dd994800-1fc5-44ad-8277-be09e974f990" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d890774f-ade8-4d5b-9af9-51a9cefb746f]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:54 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990 Apr 16 14:44:54 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:54 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.407s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:54 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Deleted volume successfully. Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-75047390-4b9f-4390-a339-59e3d14a1671 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-46e06d55-5ea6-4974-839f-af3d273be122-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:54 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990" returned: 0 in 0.453s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:55 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990 Apr 16 14:44:55 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:55 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dd994800-1fc5-44ad-8277-be09e974f990" returned: 0 in 0.389s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-quobyte-dd994800-1fc5-44ad-8277-be09e974f990" released by "delete_volume" :: held 0.865s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Created reservations ['9ae3198c-97c9-488d-82c8-33e383023df5', 'dcce37a8-a4eb-45a5-80d2-39e9e6e199ad', 'aa2adb55-c0ad-48ea-a96c-c34a3da210e6', '256c9705-2f80-41ff-a2e7-4bae16b78b63'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:44:55 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:44:55 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:44:55 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.436s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:44:55 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Deleted volume successfully. Apr 16 14:44:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-70b47162-6af6-4f2b-ad4b-dbaed0042b08 tempest-CreateVolumesFromSourceVolumeTest-1233335789 None] Lock "cinder-dd994800-1fc5-44ad-8277-be09e974f990-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Flow 'volume_create_manager' (a051bb1f-69b7-46f3-b790-149550c11dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd51fc0f-7c22-4697-a9ea-7c9f24482155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd51fc0f-7c22-4697-a9ea-7c9f24482155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1402602732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b9fc52-602e-410c-8b73-ea0f06fcee2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f788b0d1a7db468e909d5facd6c27892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:02Z,use_quota=True,user_id='857941e4bad743d7be60881a22d71f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25613dc-1e9f-459e-a853-be15e64d087d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25613dc-1e9f-459e-a853-be15e64d087d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24a8700-c9f1-4fef-a6d7-47d19082042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24a8700-c9f1-4fef-a6d7-47d19082042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b9fc52-602e-410c-8b73-ea0f06fcee2c', 'volume_name': 'volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a58505f-2d67-475c-999f-6d8a66b0c74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a58505f-2d67-475c-999f-6d8a66b0c74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1705f4d-7bca-468d-a420-c36992a64be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Volume f9b9fc52-602e-410c-8b73-ea0f06fcee2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c', 'volume_size': 1} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1402602732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b9fc52-602e-410c-8b73-ea0f06fcee2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f788b0d1a7db468e909d5facd6c27892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:02Z,use_quota=True,user_id='857941e4bad743d7be60881a22d71f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Creating volume f9b9fc52-602e-410c-8b73-ea0f06fcee2c {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:02 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:02 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c 1073741824 Apr 16 14:45:02 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Flow 'volume_create_manager' (b1a0eae0-93ac-4a7b-bb86-6a6cf7838be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a932818-32aa-408c-8c41-9711fd7494f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a932818-32aa-408c-8c41-9711fd7494f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-419321020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed85003-1f47-4b78-8c94-30afecc29dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386e59ec1bb54d0aadec11622ff4e6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:02Z,use_quota=True,user_id='b51bc4154030414f8103cc56999744cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b2bca6-7ddc-4c38-adbf-620269c7a1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b2bca6-7ddc-4c38-adbf-620269c7a1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc919b1-4d28-48cc-bd4f-5dc7797791e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc919b1-4d28-48cc-bd4f-5dc7797791e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed85003-1f47-4b78-8c94-30afecc29dc3', 'volume_name': 'volume-4ed85003-1f47-4b78-8c94-30afecc29dc3', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27fec86-e8fa-41b8-92fc-235d10a23671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27fec86-e8fa-41b8-92fc-235d10a23671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82af4b00-5e2f-4f3d-a930-a7b8cd816fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Volume 4ed85003-1f47-4b78-8c94-30afecc29dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed85003-1f47-4b78-8c94-30afecc29dc3', 'volume_size': 1} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Flow 'volume_create_manager' (6bfcf481-beb0-4c85-8405-1785775937fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191175a3-5bb4-40c2-a308-dea457901b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191175a3-5bb4-40c2-a308-dea457901b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612631154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e6f675-648d-4832-86e0-496c4007608a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386e59ec1bb54d0aadec11622ff4e6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:03Z,use_quota=True,user_id='b51bc4154030414f8103cc56999744cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12182aa2-86d3-4e07-ad90-d6ea7d8e018a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12182aa2-86d3-4e07-ad90-d6ea7d8e018a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa6be84-7fbc-4db9-8433-36a9191d7248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa6be84-7fbc-4db9-8433-36a9191d7248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e6f675-648d-4832-86e0-496c4007608a', 'volume_name': 'volume-75e6f675-648d-4832-86e0-496c4007608a', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2c5b44-72e0-4596-82a2-b53a43fb8b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2c5b44-72e0-4596-82a2-b53a43fb8b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aceb4c4-37d2-40ac-b2d5-3c997ed22551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Volume 75e6f675-648d-4832-86e0-496c4007608a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e6f675-648d-4832-86e0-496c4007608a', 'volume_size': 1} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (1bc035be-e9a3-461c-b5d9-98180bd5cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e78171-a203-4a87-a845-4db48d2d6c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e78171-a203-4a87-a845-4db48d2d6c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000031370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfff99c-109e-4a20-8808-09f4ffdbcd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:03Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bc943d-c995-4f4c-8a8f-cf45bbe04051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bc943d-c995-4f4c-8a8f-cf45bbe04051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:02 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3315375f-be59-4309-848e-4e436e574eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3315375f-be59-4309-848e-4e436e574eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcfff99c-109e-4a20-8808-09f4ffdbcd62', 'volume_name': 'volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6947cd5-ff2b-4be4-9234-db2131c7ab10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6947cd5-ff2b-4be4-9234-db2131c7ab10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5e9dde-6eae-4a70-87d9-09ecb050a316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume dcfff99c-109e-4a20-8808-09f4ffdbcd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62', 'volume_size': 1} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Flow 'volume_create_manager' (dc44d31e-fbe2-473a-b466-8dee3c9f5913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5f7e42-ccdd-4f0e-8c84-822a309eba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5f7e42-ccdd-4f0e-8c84-822a309eba19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-709844520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46139bd5-ed0c-4f85-8807-df9be5e49461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386e59ec1bb54d0aadec11622ff4e6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:03Z,use_quota=True,user_id='b51bc4154030414f8103cc56999744cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e6ad56-8e89-4806-9ad7-aa33f6f6b328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e6ad56-8e89-4806-9ad7-aa33f6f6b328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e31f095-46c4-4c55-80fc-7b79aedcfad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e31f095-46c4-4c55-80fc-7b79aedcfad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46139bd5-ed0c-4f85-8807-df9be5e49461', 'volume_name': 'volume-46139bd5-ed0c-4f85-8807-df9be5e49461', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ad167f-2feb-4b51-9735-dd9413f4f11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ad167f-2feb-4b51-9735-dd9413f4f11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e359ad7c-f94a-468b-9deb-b09efc6202a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Volume 46139bd5-ed0c-4f85-8807-df9be5e49461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46139bd5-ed0c-4f85-8807-df9be5e49461', 'volume_size': 1} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Flow 'volume_create_manager' (21117f42-4885-4606-bcc7-28bd422dac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0b158c-e6e6-46ba-8777-a33b1078b61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0b158c-e6e6-46ba-8777-a33b1078b61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-525679971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23505abb-25fa-48e9-a85d-9e64ff63f7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386e59ec1bb54d0aadec11622ff4e6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:03Z,use_quota=True,user_id='b51bc4154030414f8103cc56999744cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edd8631-02a6-4050-bbe3-8604bede6010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edd8631-02a6-4050-bbe3-8604bede6010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2486e04-b609-415b-8fc8-96127deadfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2486e04-b609-415b-8fc8-96127deadfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23505abb-25fa-48e9-a85d-9e64ff63f7ea', 'volume_name': 'volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481de7df-6b8e-4938-883e-5656c54be28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481de7df-6b8e-4938-883e-5656c54be28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777e27f2-b204-4447-b989-f546db80951b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Volume 23505abb-25fa-48e9-a85d-9e64ff63f7ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea', 'volume_size': 1} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c 1073741824" returned: 0 in 0.854s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:03 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c Apr 16 14:45:03 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Flow 'volume_create_manager' (938b8f07-5939-41dc-b08f-2eab1793ba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549de560-20a4-459c-aef6-468949585ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549de560-20a4-459c-aef6-468949585ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-507750107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f541d285-390a-4f50-b3f1-3c70427e6bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386e59ec1bb54d0aadec11622ff4e6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:03Z,use_quota=True,user_id='b51bc4154030414f8103cc56999744cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972b9dd3-40c9-4180-9a98-a69ecb51d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972b9dd3-40c9-4180-9a98-a69ecb51d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0ce6e6-ef00-4b37-bc2a-88ce3b67a55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0ce6e6-ef00-4b37-bc2a-88ce3b67a55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f541d285-390a-4f50-b3f1-3c70427e6bde', 'volume_name': 'volume-f541d285-390a-4f50-b3f1-3c70427e6bde', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5aa0e8-8fc4-4ebe-9835-55453cb4d91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5aa0e8-8fc4-4ebe-9835-55453cb4d91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab2b2eb-d909-4a3b-b5d0-c323b10811a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Volume f541d285-390a-4f50-b3f1-3c70427e6bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f541d285-390a-4f50-b3f1-3c70427e6bde', 'volume_size': 1} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:03 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" returned: 0 in 0.461s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-419321020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed85003-1f47-4b78-8c94-30afecc29dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386e59ec1bb54d0aadec11622ff4e6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:02Z,use_quota=True,user_id='b51bc4154030414f8103cc56999744cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Creating volume 4ed85003-1f47-4b78-8c94-30afecc29dc3 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:03 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1705f4d-7bca-468d-a420-c36992a64be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3 1073741824 Apr 16 14:45:03 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bdec99-e78d-4758-b754-bb645a3bb8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:03 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Volume volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c (f9b9fc52-602e-410c-8b73-ea0f06fcee2c): created successfully Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bdec99-e78d-4758-b754-bb645a3bb8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:03 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Flow 'volume_create_manager' (a051bb1f-69b7-46f3-b790-149550c11dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:03 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-80af7927-fd1a-463f-a040-b798eeff1f0f tempest-VolumeDependencyTests-1581818165 None] Created volume successfully. Apr 16 14:45:04 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3 1073741824" returned: 0 in 0.482s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:04 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3 Apr 16 14:45:04 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:04 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3" returned: 0 in 0.467s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.848s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612631154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e6f675-648d-4832-86e0-496c4007608a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386e59ec1bb54d0aadec11622ff4e6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:03Z,use_quota=True,user_id='b51bc4154030414f8103cc56999744cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Creating volume 75e6f675-648d-4832-86e0-496c4007608a {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:04 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82af4b00-5e2f-4f3d-a930-a7b8cd816fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed85003-1f47-4b78-8c94-30afecc29dc3', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a48abd0-08fa-4d4e-b205-ac0eb3488a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:04 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a 1073741824 Apr 16 14:45:04 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:04 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Volume volume-4ed85003-1f47-4b78-8c94-30afecc29dc3 (4ed85003-1f47-4b78-8c94-30afecc29dc3): created successfully Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a48abd0-08fa-4d4e-b205-ac0eb3488a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:04 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Flow 'volume_create_manager' (b1a0eae0-93ac-4a7b-bb86-6a6cf7838be2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:04 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a4dbb80a-1b69-4f05-a55e-8c2346376437 tempest-CreateVolumesFromImageTest-2026213921 None] Created volume successfully. Apr 16 14:45:05 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a 1073741824" returned: 0 in 0.506s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:05 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a Apr 16 14:45:05 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:05 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a" returned: 0 in 0.454s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.713s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000031370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfff99c-109e-4a20-8808-09f4ffdbcd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:03Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Creating volume dcfff99c-109e-4a20-8808-09f4ffdbcd62 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:05 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aceb4c4-37d2-40ac-b2d5-3c997ed22551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e6f675-648d-4832-86e0-496c4007608a', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7555d9-b65a-46e6-9446-377199b41200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:05 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Volume volume-75e6f675-648d-4832-86e0-496c4007608a (75e6f675-648d-4832-86e0-496c4007608a): created successfully Apr 16 14:45:05 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 1073741824 Apr 16 14:45:05 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7555d9-b65a-46e6-9446-377199b41200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:05 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Flow 'volume_create_manager' (6bfcf481-beb0-4c85-8405-1785775937fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:05 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-dea30636-dea8-4830-9f55-031869292891 tempest-CreateVolumesFromImageTest-2026213921 None] Created volume successfully. Apr 16 14:45:06 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 1073741824" returned: 0 in 0.567s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:06 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 Apr 16 14:45:06 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:06 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62" returned: 0 in 0.434s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.675s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-709844520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46139bd5-ed0c-4f85-8807-df9be5e49461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386e59ec1bb54d0aadec11622ff4e6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:03Z,use_quota=True,user_id='b51bc4154030414f8103cc56999744cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Creating volume 46139bd5-ed0c-4f85-8807-df9be5e49461 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:06 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5e9dde-6eae-4a70-87d9-09ecb050a316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:06 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461 1073741824 Apr 16 14:45:06 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dfbc47-3299-420f-bee8-399f24bb2113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:06 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 (dcfff99c-109e-4a20-8808-09f4ffdbcd62): created successfully Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dfbc47-3299-420f-bee8-399f24bb2113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:06 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (1bc035be-e9a3-461c-b5d9-98180bd5cc70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:06 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-d947b83b-db68-4164-a762-58c2de51b8f3 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created volume successfully. Apr 16 14:45:07 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461 1073741824" returned: 0 in 0.509s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:07 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461 Apr 16 14:45:07 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:07 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461" returned: 0 in 0.487s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.562s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-525679971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23505abb-25fa-48e9-a85d-9e64ff63f7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386e59ec1bb54d0aadec11622ff4e6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:03Z,use_quota=True,user_id='b51bc4154030414f8103cc56999744cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Creating volume 23505abb-25fa-48e9-a85d-9e64ff63f7ea {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:07 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:07 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea 1073741824 Apr 16 14:45:07 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e359ad7c-f94a-468b-9deb-b09efc6202a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46139bd5-ed0c-4f85-8807-df9be5e49461', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1655165b-f077-4e00-92c3-02382cde6ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:07 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Volume volume-46139bd5-ed0c-4f85-8807-df9be5e49461 (46139bd5-ed0c-4f85-8807-df9be5e49461): created successfully Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1655165b-f077-4e00-92c3-02382cde6ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:07 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Flow 'volume_create_manager' (dc44d31e-fbe2-473a-b466-8dee3c9f5913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:07 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-344148fc-8a86-4001-b1bf-36453115fd59 tempest-CreateVolumesFromImageTest-2026213921 None] Created volume successfully. Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:08 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea 1073741824" returned: 0 in 0.514s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:08 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea Apr 16 14:45:08 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:08 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea" returned: 0 in 0.499s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.406s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-507750107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f541d285-390a-4f50-b3f1-3c70427e6bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386e59ec1bb54d0aadec11622ff4e6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:03Z,use_quota=True,user_id='b51bc4154030414f8103cc56999744cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Creating volume f541d285-390a-4f50-b3f1-3c70427e6bde {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:08 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777e27f2-b204-4447-b989-f546db80951b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:08 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde 1073741824 Apr 16 14:45:08 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30a72dc-9b01-433a-86c7-be82decb3fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:08 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Volume volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea (23505abb-25fa-48e9-a85d-9e64ff63f7ea): created successfully Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30a72dc-9b01-433a-86c7-be82decb3fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:08 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Flow 'volume_create_manager' (21117f42-4885-4606-bcc7-28bd422dac79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:08 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-070332ba-8319-4454-942e-31b6c97e1798 tempest-CreateVolumesFromImageTest-2026213921 None] Created volume successfully. Apr 16 14:45:09 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde 1073741824" returned: 0 in 0.572s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:09 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde Apr 16 14:45:09 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:09 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde" returned: 0 in 0.457s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.261s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] Creating offline snapshot 3541b207-3260-4458-b55d-74a3f35c39d7 of volume f9b9fc52-602e-410c-8b73-ea0f06fcee2c {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab2b2eb-d909-4a3b-b5d0-c323b10811a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f541d285-390a-4f50-b3f1-3c70427e6bde', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ac22e2-01ff-4d59-accf-6bf8dceb5649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b15f40b-801f-407a-8968-c54dfef344e5]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:09 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Volume volume-f541d285-390a-4f50-b3f1-3c70427e6bde (f541d285-390a-4f50-b3f1-3c70427e6bde): created successfully Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ac22e2-01ff-4d59-accf-6bf8dceb5649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:09 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Flow 'volume_create_manager' (938b8f07-5939-41dc-b08f-2eab1793ba8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:09 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-bb834045-4480-4f6a-9c67-51a935215358 tempest-CreateVolumesFromImageTest-2026213921 None] Created volume successfully. Apr 16 14:45:10 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c Apr 16 14:45:10 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:10 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" returned: 0 in 0.474s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:10 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 1G Apr 16 14:45:10 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:10 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 1G" returned: 0 in 0.499s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:10 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:10 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 Apr 16 14:45:10 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "cinder-f541d285-390a-4f50-b3f1-3c70427e6bde-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-f541d285-390a-4f50-b3f1-3c70427e6bde-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "cinder-quobyte-f541d285-390a-4f50-b3f1-3c70427e6bde" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-quobyte-f541d285-390a-4f50-b3f1-3c70427e6bde" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3149defe-3ac6-4bba-a00a-a92dc265c7b5]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:11 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde Apr 16 14:45:11 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:11 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7" returned: 0 in 0.469s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:11 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 is being set with open permissions: ugo+rw Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:11 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 Apr 16 14:45:11 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:11 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde" returned: 0 in 0.546s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:11 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde Apr 16 14:45:11 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:11 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7" returned: 0 in 0.461s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:11 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:11 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.info Apr 16 14:45:11 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:12 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f541d285-390a-4f50-b3f1-3c70427e6bde" returned: 0 in 0.545s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-quobyte-f541d285-390a-4f50-b3f1-3c70427e6bde" released by "delete_volume" :: held 1.121s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Created reservations ['9cbdc37c-ee39-425b-85c1-e82dff5e9722', '4e28d9b8-2b88-42ed-a1ec-2ee4664bef46', '1b162305-f129-4bb6-9b96-9fbdb22132ed', 'b5c2d730-e70a-418a-ab82-6ec095f2b359'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:12 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:12 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:12 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.info" returned: 0 in 0.520s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:12 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.info is being set with open permissions: ugo+rw Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:12 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.info Apr 16 14:45:12 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:12 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.447s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:12 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Deleted volume successfully. Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-b2d8aec0-3358-4472-9b79-ef6083af7aa2 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-f541d285-390a-4f50-b3f1-3c70427e6bde-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:12 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.info" returned: 0 in 0.461s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.952s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.791s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Creating offline snapshot 67d4b207-7c28-472e-8d12-d8187f6bc7b3 of volume dcfff99c-109e-4a20-8808-09f4ffdbcd62 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:45:12 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-096bad58-247e-4dd8-8d8e-6fc7d2797fb1 tempest-VolumeDependencyTests-1581818165 None] Create snapshot completed successfully Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbfb7c9-a5f1-4532-a78c-53b6fa92f7f5]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:12 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:13 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 Apr 16 14:45:13 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "cinder-23505abb-25fa-48e9-a85d-9e64ff63f7ea-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-23505abb-25fa-48e9-a85d-9e64ff63f7ea-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "cinder-quobyte-23505abb-25fa-48e9-a85d-9e64ff63f7ea" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:13 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-quobyte-23505abb-25fa-48e9-a85d-9e64ff63f7ea" acquired by "delete_volume" :: waited 0.015s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:13 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9153a0a9-2425-4fa2-86ce-0fe85df98ef5]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:13 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea Apr 16 14:45:13 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:13 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62" returned: 0 in 0.542s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:13 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 1G Apr 16 14:45:13 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:13 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea" returned: 0 in 0.589s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:13 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:13 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea Apr 16 14:45:13 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:14 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 1G" returned: 0 in 0.625s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:14 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 Apr 16 14:45:14 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Flow 'volume_create_manager' (5d814e9b-bcac-48aa-9095-ddb1e25acd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2446538-843e-412d-ab9d-fe0f87998503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2446538-843e-412d-ab9d-fe0f87998503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1940957775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da227ee9-3b2d-4bf3-ae29-e78aa6f1676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f788b0d1a7db468e909d5facd6c27892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3541b207-3260-4458-b55d-74a3f35c39d7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:14Z,use_quota=True,user_id='857941e4bad743d7be60881a22d71f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15320ead-2457-4500-80b9-1d1e2787c685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15320ead-2457-4500-80b9-1d1e2787c685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578ec978-107f-4add-ae7e-8118b6e452be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578ec978-107f-4add-ae7e-8118b6e452be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da227ee9-3b2d-4bf3-ae29-e78aa6f1676f', 'volume_name': 'volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f', 'volume_size': 1, 'snapshot_id': '3541b207-3260-4458-b55d-74a3f35c39d7'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a5ec27-e0bd-4b84-8911-6f6e902626a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a5ec27-e0bd-4b84-8911-6f6e902626a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48a66b9-ef20-405c-ba5e-919c98726de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:14 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Volume da227ee9-3b2d-4bf3-ae29-e78aa6f1676f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f', 'volume_size': 1, 'snapshot_id': '3541b207-3260-4458-b55d-74a3f35c39d7'} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:14 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-23505abb-25fa-48e9-a85d-9e64ff63f7ea" returned: 0 in 0.672s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-quobyte-23505abb-25fa-48e9-a85d-9e64ff63f7ea" released by "delete_volume" :: held 1.293s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Created reservations ['370ca4a5-f664-43c8-8d41-9d0b022d71c9', '804a30ee-f35b-43cc-a74a-7c62cb92cbf9', 'e3cc4601-0f0f-4678-b208-47b956ea8492', '9f16b04c-8a89-473d-aa86-0f3b607c5657'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:14 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:14 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:14 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3" returned: 0 in 0.644s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:14 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 is being set with open permissions: ugo+rw Apr 16 14:45:14 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:14 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 Apr 16 14:45:14 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:15 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.485s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:15 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Deleted volume successfully. Apr 16 14:45:15 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3" returned: 0 in 0.452s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-50c2fb9e-9fd8-4bbe-98b4-7b7f59420810 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-23505abb-25fa-48e9-a85d-9e64ff63f7ea-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:15 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.info Apr 16 14:45:15 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "cinder-46139bd5-ed0c-4f85-8807-df9be5e49461-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-46139bd5-ed0c-4f85-8807-df9be5e49461-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "cinder-quobyte-46139bd5-ed0c-4f85-8807-df9be5e49461" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-quobyte-46139bd5-ed0c-4f85-8807-df9be5e49461" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1990955c-8af5-47b0-80e4-4a65ad375447]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:15 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461 Apr 16 14:45:15 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:15 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.info" returned: 0 in 0.514s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:15 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.info is being set with open permissions: ugo+rw Apr 16 14:45:15 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:15 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.info Apr 16 14:45:15 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:16 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Flow 'volume_create_manager' (f2d50945-eae3-476a-b703-9f87720ec36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b22f6f1-f8bd-4b7c-9aa5-dd7afda54c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461" returned: 0 in 0.612s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:16 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461 Apr 16 14:45:16 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b22f6f1-f8bd-4b7c-9aa5-dd7afda54c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1014312271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e565169-6c6b-463d-99a3-632ee6138a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f13c395c88a14626a7c79695d67543ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:16Z,use_quota=True,user_id='8b43ca98cf254263a76dc20962c0fb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf90d48-1e0f-4082-9eeb-183ce6990bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf90d48-1e0f-4082-9eeb-183ce6990bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb28d424-7959-4ff0-8927-58ff8af00bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb28d424-7959-4ff0-8927-58ff8af00bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e565169-6c6b-463d-99a3-632ee6138a99', 'volume_name': 'volume-1e565169-6c6b-463d-99a3-632ee6138a99', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e22c82b-fbe0-4f24-9713-dca66c04626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e22c82b-fbe0-4f24-9713-dca66c04626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65952681-fe49-4b52-b1c7-031f37d13437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Volume 1e565169-6c6b-463d-99a3-632ee6138a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e565169-6c6b-463d-99a3-632ee6138a99', 'volume_size': 1} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:16 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.info" returned: 0 in 0.523s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.372s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.692s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-quobyte-3541b207-3260-4458-b55d-74a3f35c39d7-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" by "_create_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:16 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-36bb7447-ff32-4cf1-acd7-e0eddd933628 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Create snapshot completed successfully Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-3541b207-3260-4458-b55d-74a3f35c39d7-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Creating volume da227ee9-3b2d-4bf3-ae29-e78aa6f1676f from snapshot 3541b207-3260-4458-b55d-74a3f35c39d7 {{(pid=83305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-quobyte-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] snapshot: 3541b207-3260-4458-b55d-74a3f35c39d7, volume: da227ee9-3b2d-4bf3-ae29-e78aa6f1676f, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd91c1e6-5c43-4671-8fae-edd9e425ebde]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:16 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 Apr 16 14:45:16 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (339baa0c-452d-4b85-a45f-d55336c30b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:16 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5f2fa9-3fd4-43bd-b81e-2fc4da029bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-46139bd5-ed0c-4f85-8807-df9be5e49461" returned: 0 in 0.468s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-quobyte-46139bd5-ed0c-4f85-8807-df9be5e49461" released by "delete_volume" :: held 1.123s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5f2fa9-3fd4-43bd-b81e-2fc4da029bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1053284959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9ca69d-48f6-4c9c-a34b-bf5b4600974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:17Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59cba74-d263-40a4-8944-0f63cf7f62c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59cba74-d263-40a4-8944-0f63cf7f62c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb1c699-66a9-4c29-90b7-7dad0328d693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb1c699-66a9-4c29-90b7-7dad0328d693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9ca69d-48f6-4c9c-a34b-bf5b4600974d', 'volume_name': 'volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312b79e0-1842-49e7-a05e-28eb04c1ed33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312b79e0-1842-49e7-a05e-28eb04c1ed33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e729947-d4ea-47bd-8eec-5ba61ba85efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume cf9ca69d-48f6-4c9c-a34b-bf5b4600974d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d', 'volume_size': 1} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Created reservations ['ea28a534-5edb-4d05-8ca9-1dfe27d69a48', 'ab10fbcf-95f3-45cd-87e5-7bacf16ef636', 'c2c64792-23cb-41f0-87b9-aa62535e8141', '2ca546e7-d341-49d9-9620-f7a123bd9050'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:16 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:16 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (404beba8-d9bc-4f25-b235-e46d3a96499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e190d1-7907-417e-a88e-bdd298f6733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e190d1-7907-417e-a88e-bdd298f6733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603595973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355ce25e-500c-4da1-93cd-b6eb80e04af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:17Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da1d24a-972f-449e-a8a1-0c429c26a3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da1d24a-972f-449e-a8a1-0c429c26a3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2045428b-61f9-412d-a103-74643c8c3f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2045428b-61f9-412d-a103-74643c8c3f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355ce25e-500c-4da1-93cd-b6eb80e04af3', 'volume_name': 'volume-355ce25e-500c-4da1-93cd-b6eb80e04af3', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a3720a-fea5-4727-9a7c-5f3c5ed6f898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a3720a-fea5-4727-9a7c-5f3c5ed6f898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5cbc08-5785-412b-91fe-b47c74c04603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:16 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume 355ce25e-500c-4da1-93cd-b6eb80e04af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355ce25e-500c-4da1-93cd-b6eb80e04af3', 'volume_size': 1} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:16 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7" returned: 0 in 0.627s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56d8e31-ac08-4c05-bcc0-20fc2b34dd9c]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:16 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:17 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c Apr 16 14:45:17 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (cfefe92c-e0d3-4c9e-8827-11833d8549d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6a4549-91c5-4aa4-bd85-3f066098aa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6a4549-91c5-4aa4-bd85-3f066098aa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-764717792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c24136-8a53-40fd-8958-ccddb95e6309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:17Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3620f576-7e48-4000-b264-a0274b824ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3620f576-7e48-4000-b264-a0274b824ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92da275f-e0a1-4079-aa7b-84a641cb90b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92da275f-e0a1-4079-aa7b-84a641cb90b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c24136-8a53-40fd-8958-ccddb95e6309', 'volume_name': 'volume-30c24136-8a53-40fd-8958-ccddb95e6309', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d21af6-3e75-43c2-91b5-8d8517ec14a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d21af6-3e75-43c2-91b5-8d8517ec14a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a50b62-fbfc-49ee-a3f3-da6b428722ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume 30c24136-8a53-40fd-8958-ccddb95e6309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c24136-8a53-40fd-8958-ccddb95e6309', 'volume_size': 1} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (3b03581c-9482-4c3f-a55d-12ac7d334559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97841025-b6f8-444c-894d-b2d0afbfca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97841025-b6f8-444c-894d-b2d0afbfca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-930774285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edced40b-551a-4e0d-ac87-23edf9723619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:17Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fd8483-6c86-4976-b67a-a065c0ce3688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fd8483-6c86-4976-b67a-a065c0ce3688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c870aa-04d9-42c8-aeba-85ad334c26fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c870aa-04d9-42c8-aeba-85ad334c26fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edced40b-551a-4e0d-ac87-23edf9723619', 'volume_name': 'volume-edced40b-551a-4e0d-ac87-23edf9723619', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e715eff-d7a0-4a8e-97e5-e9c7d2397d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e715eff-d7a0-4a8e-97e5-e9c7d2397d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728da3bf-5c47-4b0e-bd58-92c4c05af7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume edced40b-551a-4e0d-ac87-23edf9723619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edced40b-551a-4e0d-ac87-23edf9723619', 'volume_size': 1} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.513s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:17 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Deleted volume successfully. Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-65305885-8feb-4d9a-82a7-150f95b13eb1 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-46139bd5-ed0c-4f85-8807-df9be5e49461-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (a75f2df9-ecfc-4f31-ba01-7fef09f38e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cb0a3f-5a8d-4a6c-8498-aeb43403a27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cb0a3f-5a8d-4a6c-8498-aeb43403a27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-624723867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:17Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c3b3d6-57b3-4ec1-97a1-ddde4cae6de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c3b3d6-57b3-4ec1-97a1-ddde4cae6de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ec6979-14e9-4c29-816e-92fa23949632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ec6979-14e9-4c29-816e-92fa23949632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224', 'volume_name': 'volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0faaab-c55c-49e3-846a-94ff60f50229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0faaab-c55c-49e3-846a-94ff60f50229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2631df-7a44-4050-904e-a1b1cc9ec384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:17 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224', 'volume_size': 1} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:17 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" returned: 0 in 0.557s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:17 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f Apr 16 14:45:17 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "cinder-75e6f675-648d-4832-86e0-496c4007608a-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-75e6f675-648d-4832-86e0-496c4007608a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "cinder-quobyte-75e6f675-648d-4832-86e0-496c4007608a" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-quobyte-75e6f675-648d-4832-86e0-496c4007608a" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28b3f1f-3d5c-4401-b251-374b5d68a5d3]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:17 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:17 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a Apr 16 14:45:17 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:18 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a" returned: 0 in 0.843s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:18 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:18 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a Apr 16 14:45:18 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:19 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-75e6f675-648d-4832-86e0-496c4007608a" returned: 0 in 0.848s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-quobyte-75e6f675-648d-4832-86e0-496c4007608a" released by "delete_volume" :: held 1.725s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Created reservations ['a4c8f93d-bf76-400b-bbc4-469f0f140580', 'cf499128-c22c-45b2-a137-506cb8756116', '043dd7c3-3e46-4d54-9f0a-c6d4fe3a6944', '0dae59c4-0dec-45e1-915a-a2e21707a04e'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:19 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:19 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:19 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" returned: 0 in 2.148s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[308785c4-6630-49c6-909f-a917b6b83868]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:19 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:19 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c Apr 16 14:45:19 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:20 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.398s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:20 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Deleted volume successfully. Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cadeebb7-c462-4ca5-b363-21688380b283 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-75e6f675-648d-4832-86e0-496c4007608a-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "cinder-4ed85003-1f47-4b78-8c94-30afecc29dc3-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-4ed85003-1f47-4b78-8c94-30afecc29dc3-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "cinder-quobyte-4ed85003-1f47-4b78-8c94-30afecc29dc3" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-quobyte-4ed85003-1f47-4b78-8c94-30afecc29dc3" acquired by "delete_volume" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac6cd59-42ce-4522-8d43-dc4d795df2fd]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:20 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3 Apr 16 14:45:20 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:20 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" returned: 0 in 0.601s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:45:20 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Converted 1024.00 MB image at 476.31 MB/s Apr 16 14:45:20 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f is being set with open permissions: ugo+rw Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:20 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f Apr 16 14:45:20 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:20 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3" returned: 0 in 0.462s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:20 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3 Apr 16 14:45:20 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:20 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" returned: 0 in 0.428s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" released by "_copy_volume_from_snapshot" :: held 4.419s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-3541b207-3260-4458-b55d-74a3f35c39d7-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" released by "_create_volume_from_snapshot" :: held 4.435s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.457s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.517s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1014312271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e565169-6c6b-463d-99a3-632ee6138a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f13c395c88a14626a7c79695d67543ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:16Z,use_quota=True,user_id='8b43ca98cf254263a76dc20962c0fb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Creating volume 1e565169-6c6b-463d-99a3-632ee6138a99 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:20 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:20 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 1073741824 Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48a66b9-ef20-405c-ba5e-919c98726de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f', 'volume_size': 1, 'snapshot_id': '3541b207-3260-4458-b55d-74a3f35c39d7'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:20 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6e5ccb-a87c-4276-887e-deeb644b3d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:20 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Volume volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f (da227ee9-3b2d-4bf3-ae29-e78aa6f1676f): created successfully Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6e5ccb-a87c-4276-887e-deeb644b3d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:20 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Flow 'volume_create_manager' (5d814e9b-bcac-48aa-9095-ddb1e25acd6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:20 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-d8e26c12-8129-4a85-96a4-4802156ba7cd tempest-VolumeDependencyTests-1581818165 None] Created volume successfully. Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-3541b207-3260-4458-b55d-74a3f35c39d7-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-3541b207-3260-4458-b55d-74a3f35c39d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-quobyte-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-quobyte-3541b207-3260-4458-b55d-74a3f35c39d7" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-3541b207-3260-4458-b55d-74a3f35c39d7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Deleting offline snapshot 3541b207-3260-4458-b55d-74a3f35c39d7 of volume f9b9fc52-602e-410c-8b73-ea0f06fcee2c {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] snapshot_file for this snap is: volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc049484-84c8-4480-8f1c-b24415e0c16d]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:21 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4ed85003-1f47-4b78-8c94-30afecc29dc3" returned: 0 in 0.476s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-quobyte-4ed85003-1f47-4b78-8c94-30afecc29dc3" released by "delete_volume" :: held 0.969s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Created reservations ['ab627d84-5baa-4b69-a0f2-d571a65dcc37', '673af29c-2e6b-44a9-ba93-74a224e568c9', '0dd3ed7f-5b32-4537-bc86-03d16cf1e7f6', 'b901fd46-8095-49d7-ade8-d1f07a05c0b4'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:21 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 Apr 16 14:45:21 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:21 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:21 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:21 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 1073741824" returned: 0 in 0.598s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:21 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 Apr 16 14:45:21 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:21 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7" returned: 0 in 0.695s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fc11dc-abfc-4ca1-9152-08cf5b39df54]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:21 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.676s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:21 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99" returned: 0 in 0.530s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:21 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c Apr 16 14:45:21 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:21 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Deleted volume successfully. Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.204s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1053284959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9ca69d-48f6-4c9c-a34b-bf5b4600974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:17Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Creating volume cf9ca69d-48f6-4c9c-a34b-bf5b4600974d {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:21 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65952681-fe49-4b52-b1c7-031f37d13437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e565169-6c6b-463d-99a3-632ee6138a99', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:21 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d 1073741824 Apr 16 14:45:21 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0946bd1a-b556-4219-8a92-c77cf27b5067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9e27d4e4-adcd-45d9-9b62-3d7dc36ce096 tempest-CreateVolumesFromImageTest-2026213921 None] Lock "cinder-4ed85003-1f47-4b78-8c94-30afecc29dc3-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:21 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Volume volume-1e565169-6c6b-463d-99a3-632ee6138a99 (1e565169-6c6b-463d-99a3-632ee6138a99): created successfully Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0946bd1a-b556-4219-8a92-c77cf27b5067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:21 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Flow 'volume_create_manager' (f2d50945-eae3-476a-b703-9f87720ec36b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:21 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-107a5de4-73df-4d6b-8a2a-660fab4c4a37 tempest-SnapshotDependencyTests-1110343694 None] Created volume successfully. Apr 16 14:45:22 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" returned: 0 in 0.618s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:22 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 Apr 16 14:45:22 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:22 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d 1073741824" returned: 0 in 0.521s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:22 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d Apr 16 14:45:22 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:22 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d" returned: 0 in 0.463s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.038s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603595973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355ce25e-500c-4da1-93cd-b6eb80e04af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:17Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Creating volume 355ce25e-500c-4da1-93cd-b6eb80e04af3 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:22 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:22 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7" returned: 0 in 0.552s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:22 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3 1073741824 Apr 16 14:45:22 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e729947-d4ea-47bd-8eec-5ba61ba85efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:22 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d5cb98-6996-48fd-b747-3b9cf28b1124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:22 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d (cf9ca69d-48f6-4c9c-a34b-bf5b4600974d): created successfully Apr 16 14:45:23 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7 Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d5cb98-6996-48fd-b747-3b9cf28b1124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:23 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (339baa0c-452d-4b85-a45f-d55336c30b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:23 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e5e8e144-e5e0-4ebe-8c53-48d0427ad5fc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created volume successfully. Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (94924880-c751-4176-96e7-139fcb2f37b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4687e8a8-cd0e-4497-ae73-dc0cc77185a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4687e8a8-cd0e-4497-ae73-dc0cc77185a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1853803321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeef6f89-ecdf-4e93-9c1f-13446ff2d755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:23Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebe14b1-a972-4a2c-9a52-47f814e6da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebe14b1-a972-4a2c-9a52-47f814e6da8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fcd888-12a9-427a-91de-ce223faac4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fcd888-12a9-427a-91de-ce223faac4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeef6f89-ecdf-4e93-9c1f-13446ff2d755', 'volume_name': 'volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f4e0ba-94aa-4054-835c-9857c6e445a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f4e0ba-94aa-4054-835c-9857c6e445a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b655a0aa-e629-4f1b-be11-f94259343e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:23 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume aeef6f89-ecdf-4e93-9c1f-13446ff2d755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755', 'volume_size': 1} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:23 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3 1073741824" returned: 0 in 0.534s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:23 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c.3541b207-3260-4458-b55d-74a3f35c39d7" returned: 0 in 0.522s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-3541b207-3260-4458-b55d-74a3f35c39d7" released by "_delete_snapshot" :: held 2.466s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" released by "delete_snapshot" :: held 2.482s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:23 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3 Apr 16 14:45:23 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Created reservations ['f0d002df-0016-4791-a51a-9e691cd4ea6a', 'b8c917c8-3ab7-45aa-8d85-83bc120a1986', 'b2abb2e6-1ef6-40ee-b722-6f1990bac40a', '4de81133-6e1d-4db7-b067-3207a18480ec'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:23 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Delete snapshot completed successfully. Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-86571c4e-d3aa-49a6-a80d-4511d1834b6f tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-3541b207-3260-4458-b55d-74a3f35c39d7-delete_snapshot" released by "delete_snapshot" :: held 2.575s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:23 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3" returned: 0 in 0.440s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.799s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-764717792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c24136-8a53-40fd-8958-ccddb95e6309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:17Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Creating volume 30c24136-8a53-40fd-8958-ccddb95e6309 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:23 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5cbc08-5785-412b-91fe-b47c74c04603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355ce25e-500c-4da1-93cd-b6eb80e04af3', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:23 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309 1073741824 Apr 16 14:45:23 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3dba1ec-e858-4640-9c43-45a0e2bc15ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:23 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume volume-355ce25e-500c-4da1-93cd-b6eb80e04af3 (355ce25e-500c-4da1-93cd-b6eb80e04af3): created successfully Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3dba1ec-e858-4640-9c43-45a0e2bc15ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:23 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (404beba8-d9bc-4f25-b235-e46d3a96499f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:23 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-bbf6161c-2155-4f90-8bc2-452975717cf1 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created volume successfully. Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-f9b9fc52-602e-410c-8b73-ea0f06fcee2c-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-f9b9fc52-602e-410c-8b73-ea0f06fcee2c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-quobyte-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1d7ad3-b85e-4e8e-8f51-8b8cd6fc3a3c]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:24 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c Apr 16 14:45:24 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:24 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309 1073741824" returned: 0 in 0.501s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:24 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309 Apr 16 14:45:24 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:24 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" returned: 0 in 0.529s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:24 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c Apr 16 14:45:24 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:24 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309" returned: 0 in 0.428s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.608s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-930774285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edced40b-551a-4e0d-ac87-23edf9723619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:17Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Creating volume edced40b-551a-4e0d-ac87-23edf9723619 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:24 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a50b62-fbfc-49ee-a3f3-da6b428722ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c24136-8a53-40fd-8958-ccddb95e6309', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066fc933-1a36-45a3-881e-7820f53550c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:24 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619 1073741824 Apr 16 14:45:24 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:24 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume volume-30c24136-8a53-40fd-8958-ccddb95e6309 (30c24136-8a53-40fd-8958-ccddb95e6309): created successfully Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066fc933-1a36-45a3-881e-7820f53550c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:24 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (cfefe92c-e0d3-4c9e-8827-11833d8549d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:24 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-bb888be7-5b86-483c-a553-48169c35c522 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created volume successfully. Apr 16 14:45:25 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" returned: 0 in 0.435s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-f9b9fc52-602e-410c-8b73-ea0f06fcee2c" released by "delete_volume" :: held 1.005s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Created reservations ['faf64318-97e8-4267-abf8-3b6cce7fb5ae', 'eff83348-40e0-4cd4-a483-8fef03931dc6', 'a378e2f2-f84e-431d-b114-0dcbb595ce2d', '6415253f-18f5-4991-9727-d500354b7641'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:25 devstack sudo[91340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:25 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:25 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619 1073741824" returned: 0 in 0.511s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:25 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619 Apr 16 14:45:25 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:25 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.405s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:25 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Deleted volume successfully. Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-201a4fdb-aca1-4500-a991-641c73dc684c tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-f9b9fc52-602e-410c-8b73-ea0f06fcee2c-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:25 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619" returned: 0 in 0.435s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.426s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-624723867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba89ae75f0a143c8991204eb3c8062f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:17Z,use_quota=True,user_id='e4426f1b05cd43c6945dbf0a204f2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Creating volume b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:25 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728da3bf-5c47-4b0e-bd58-92c4c05af7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edced40b-551a-4e0d-ac87-23edf9723619', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:25 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224 1073741824 Apr 16 14:45:25 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0f1a25-4df7-4196-8b32-f3d1743a8fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:25 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume volume-edced40b-551a-4e0d-ac87-23edf9723619 (edced40b-551a-4e0d-ac87-23edf9723619): created successfully Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0f1a25-4df7-4196-8b32-f3d1743a8fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:25 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (3b03581c-9482-4c3f-a55d-12ac7d334559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:25 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e5cd7545-0e6f-4516-9802-538b5d8550d7 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created volume successfully. Apr 16 14:45:26 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224 1073741824" returned: 0 in 0.509s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:26 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224 Apr 16 14:45:26 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Flow 'volume_create_manager' (ec77248e-e4cb-493f-9320-88850a0a3288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5fe560-404e-4805-8731-bb37ea330255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5fe560-404e-4805-8731-bb37ea330255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-761965791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c470a4-7c6b-4422-b480-6382cee7071c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f788b0d1a7db468e909d5facd6c27892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:27Z,use_quota=True,user_id='857941e4bad743d7be60881a22d71f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830ef1aa-02bf-4adf-a2cb-0d2e60bfbf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830ef1aa-02bf-4adf-a2cb-0d2e60bfbf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5422719-34ed-4223-b32c-633a41340718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5422719-34ed-4223-b32c-633a41340718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c470a4-7c6b-4422-b480-6382cee7071c', 'volume_name': 'volume-22c470a4-7c6b-4422-b480-6382cee7071c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa47feef-8474-426d-8933-a8c46b3a280e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa47feef-8474-426d-8933-a8c46b3a280e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c27d38-969f-4642-93ac-fde53dba50b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:26 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Volume 22c470a4-7c6b-4422-b480-6382cee7071c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c470a4-7c6b-4422-b480-6382cee7071c', 'volume_size': 1} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:26 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224" returned: 0 in 0.412s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.759s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2631df-7a44-4050-904e-a1b1cc9ec384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecb72cd-1408-49ac-8a7e-4fd34499e139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] Creating offline snapshot 69a3cf26-a723-4d1c-b069-1cb34cd6917a of volume 1e565169-6c6b-463d-99a3-632ee6138a99 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:45:26 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Volume volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224 (b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224): created successfully Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecb72cd-1408-49ac-8a7e-4fd34499e139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Flow 'volume_create_manager' (a75f2df9-ecfc-4f31-ba01-7fef09f38e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[283d0c90-9453-4b52-ab02-5059e0278112]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:26 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:26 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a28aebce-ba0e-4806-b1d6-ad6dcb21e4dc tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created volume successfully. Apr 16 14:45:26 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 Apr 16 14:45:26 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-quobyte-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa4d3f2-2168-4d17-bb09-4024df434140]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:27 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99" returned: 0 in 0.514s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:27 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a 1G Apr 16 14:45:27 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:27 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224 Apr 16 14:45:27 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:27 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a 1G" returned: 0 in 0.474s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e565169-6c6b-463d-99a3-632ee6138a99 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:27 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:27 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e565169-6c6b-463d-99a3-632ee6138a99 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a Apr 16 14:45:27 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224" returned: 0 in 0.507s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:27 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:27 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224 Apr 16 14:45:27 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:28 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224" returned: 0 in 0.403s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224" released by "delete_volume" :: held 0.955s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:28 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e565169-6c6b-463d-99a3-632ee6138a99 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a" returned: 0 in 0.458s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:28 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a is being set with open permissions: ugo+rw Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created reservations ['9f7900fd-9fdb-446e-88a1-fccbf5b8c2c3', '1167e218-d924-4abe-b8d5-d68e63cd5967', '51871f60-d0d4-4aef-8ce1-3bc5f2ca4f69', '8522972e-06cc-4757-b139-9f9c0dff1a46'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:28 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a Apr 16 14:45:28 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:28 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:28 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-edced40b-551a-4e0d-ac87-23edf9723619-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-edced40b-551a-4e0d-ac87-23edf9723619-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-quobyte-edced40b-551a-4e0d-ac87-23edf9723619" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-edced40b-551a-4e0d-ac87-23edf9723619" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9816dba-c6a9-481f-9298-b06a7a9ac222]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:28 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619 Apr 16 14:45:28 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:28 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a" returned: 0 in 0.452s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:28 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.info Apr 16 14:45:28 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:28 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.446s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:28 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Deleted volume successfully. Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1c73201c-7641-4ec6-be1c-d9c6f223b221 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-b38cecb8-3e7d-4e4a-b6b9-3b7aaaeed224-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:28 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619" returned: 0 in 0.463s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:28 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:28 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619 Apr 16 14:45:28 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:29 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.info" returned: 0 in 0.431s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:29 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.info is being set with open permissions: ugo+rw Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:29 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.info Apr 16 14:45:29 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:29 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-edced40b-551a-4e0d-ac87-23edf9723619" returned: 0 in 0.430s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-edced40b-551a-4e0d-ac87-23edf9723619" released by "delete_volume" :: held 0.917s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created reservations ['2993c6ab-4014-45e2-b525-f2c195c19da2', 'cff1e520-e855-4eb5-be5d-dc317637c087', '2ea7afc4-fff1-4c78-90f0-389dab2e460f', 'c59409c5-a693-4e9e-8bc9-830846fe5f6b'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:29 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:29 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-30c24136-8a53-40fd-8958-ccddb95e6309-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-30c24136-8a53-40fd-8958-ccddb95e6309-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-quobyte-30c24136-8a53-40fd-8958-ccddb95e6309" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-30c24136-8a53-40fd-8958-ccddb95e6309" acquired by "delete_volume" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c289aaeb-7c86-4f59-b638-675f8de07ff1]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:29 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309 Apr 16 14:45:29 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:29 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.info" returned: 0 in 0.470s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.459s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1853803321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeef6f89-ecdf-4e93-9c1f-13446ff2d755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:23Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Creating volume aeef6f89-ecdf-4e93-9c1f-13446ff2d755 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:29 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:29 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-33f424fc-a80a-4867-9e12-4423987052ab tempest-SnapshotDependencyTests-1110343694 None] Create snapshot completed successfully Apr 16 14:45:29 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755 1073741824 Apr 16 14:45:29 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:29 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.441s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:29 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Deleted volume successfully. Apr 16 14:45:29 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-ce8ee33e-7258-443e-adf0-72bada2b506f tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-edced40b-551a-4e0d-ac87-23edf9723619-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:30 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309" returned: 0 in 0.498s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:30 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309 Apr 16 14:45:30 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:30 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755 1073741824" returned: 0 in 0.453s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:30 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755 Apr 16 14:45:30 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:30 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-30c24136-8a53-40fd-8958-ccddb95e6309" returned: 0 in 0.500s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Flow 'volume_create_manager' (f7871c13-3bf7-4c3e-9a48-d5f843082898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3d5012-3245-4214-bb1c-28a4408d03b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-30c24136-8a53-40fd-8958-ccddb95e6309" released by "delete_volume" :: held 1.049s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3d5012-3245-4214-bb1c-28a4408d03b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcc8231-dcfe-4110-898d-b6f8ec9bbd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f13c395c88a14626a7c79695d67543ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69a3cf26-a723-4d1c-b069-1cb34cd6917a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:31Z,use_quota=True,user_id='8b43ca98cf254263a76dc20962c0fb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad66a58b-3364-4308-a63d-8e6d1e4c30fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad66a58b-3364-4308-a63d-8e6d1e4c30fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f99046-9840-452e-b753-9ee33d1f9286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f99046-9840-452e-b753-9ee33d1f9286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4fcc8231-dcfe-4110-898d-b6f8ec9bbd60', 'volume_name': 'volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60', 'volume_size': 1, 'snapshot_id': '69a3cf26-a723-4d1c-b069-1cb34cd6917a'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989d6bfe-67e2-4e95-a34e-7fe19f676e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989d6bfe-67e2-4e95-a34e-7fe19f676e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b6d9c0-4ccb-4e8a-97e3-5265f2f2b9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:30 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Volume 4fcc8231-dcfe-4110-898d-b6f8ec9bbd60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60', 'volume_size': 1, 'snapshot_id': '69a3cf26-a723-4d1c-b069-1cb34cd6917a'} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created reservations ['ff0c1b94-c426-4dbb-828c-6aeeba52e6cc', 'd6d02a3d-1c4f-4d15-a8d3-bf2fa7c52cbc', '76c82d89-0bdd-45b2-8d5b-7cf444b01325', '7c4f8ad1-4241-4581-bafe-a18b121c2a0d'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:30 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755" returned: 0 in 0.510s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.035s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-761965791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c470a4-7c6b-4422-b480-6382cee7071c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f788b0d1a7db468e909d5facd6c27892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:27Z,use_quota=True,user_id='857941e4bad743d7be60881a22d71f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Creating volume 22c470a4-7c6b-4422-b480-6382cee7071c {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:30 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b655a0aa-e629-4f1b-be11-f94259343e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c9e2c8-3ad5-4249-b2c0-8e2018a2bfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:30 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c 1073741824 Apr 16 14:45:30 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:30 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755 (aeef6f89-ecdf-4e93-9c1f-13446ff2d755): created successfully Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c9e2c8-3ad5-4249-b2c0-8e2018a2bfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:30 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (94924880-c751-4176-96e7-139fcb2f37b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:30 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:30 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:30 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-da0d55de-831f-4a03-a973-842dbd18a029 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created volume successfully. Apr 16 14:45:31 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.456s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:31 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Deleted volume successfully. Apr 16 14:45:31 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1eac75d-72b4-47f3-ac75-7206b3c35b2a tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-30c24136-8a53-40fd-8958-ccddb95e6309-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c 1073741824" returned: 0 in 0.501s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:31 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c Apr 16 14:45:31 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-355ce25e-500c-4da1-93cd-b6eb80e04af3-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-355ce25e-500c-4da1-93cd-b6eb80e04af3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:31 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c" returned: 0 in 0.468s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.057s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "cinder-quobyte-69a3cf26-a723-4d1c-b069-1cb34cd6917a-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" by "_create_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c27d38-969f-4642-93ac-fde53dba50b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c470a4-7c6b-4422-b480-6382cee7071c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30190ca3-65aa-4723-a329-48d97297813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-quobyte-355ce25e-500c-4da1-93cd-b6eb80e04af3" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-69a3cf26-a723-4d1c-b069-1cb34cd6917a-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Creating volume 4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 from snapshot 69a3cf26-a723-4d1c-b069-1cb34cd6917a {{(pid=83305) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "cinder-quobyte-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:31 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Volume volume-22c470a4-7c6b-4422-b480-6382cee7071c (22c470a4-7c6b-4422-b480-6382cee7071c): created successfully Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30190ca3-65aa-4723-a329-48d97297813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Flow 'volume_create_manager' (ec77248e-e4cb-493f-9320-88850a0a3288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:31 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-7b682795-5ac2-493b-bdfb-164594c3e414 tempest-VolumeDependencyTests-1581818165 None] Created volume successfully. Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] snapshot: 69a3cf26-a723-4d1c-b069-1cb34cd6917a, volume: 4fcc8231-dcfe-4110-898d-b6f8ec9bbd60, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-355ce25e-500c-4da1-93cd-b6eb80e04af3" acquired by "delete_volume" :: waited 0.040s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf5a611-106b-49b0-95ea-729029e3ad40]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb9ae46-352a-4657-a7e3-04ca7c1ca66b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:31 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3 Apr 16 14:45:31 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (bd6fba15-a91f-49c9-aa5e-9f20cfa0ce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdb1929-8f3d-472f-9746-7cbf597b3282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdb1929-8f3d-472f-9746-7cbf597b3282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1404326067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ba15ba-9301-4c98-9795-4c3217d84f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:32Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:31 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a Apr 16 14:45:31 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be49571e-fb4c-474a-bf83-bd400e6425ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be49571e-fb4c-474a-bf83-bd400e6425ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:31 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a77c960-fea1-4325-80dc-559c3e84f132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a77c960-fea1-4325-80dc-559c3e84f132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ba15ba-9301-4c98-9795-4c3217d84f3c', 'volume_name': 'volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77acff4-3261-46d6-8259-c1590c3dba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77acff4-3261-46d6-8259-c1590c3dba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29de9e07-fc4d-427a-9198-647455475797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume f5ba15ba-9301-4c98-9795-4c3217d84f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c', 'volume_size': 1} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (590d60f6-c404-4f9c-9526-bda67876d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379d025d-b488-4750-83b6-aab77deba61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379d025d-b488-4750-83b6-aab77deba61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794514448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad11f7d7-a16f-460c-9708-65ca72b1e483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:32Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6100a887-0d82-48db-ab03-bbdddbb7c63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6100a887-0d82-48db-ab03-bbdddbb7c63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22605dd-b4b4-4739-bb4e-e5e77adc358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22605dd-b4b4-4739-bb4e-e5e77adc358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad11f7d7-a16f-460c-9708-65ca72b1e483', 'volume_name': 'volume-ad11f7d7-a16f-460c-9708-65ca72b1e483', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227a910e-65fc-4842-8dc8-535db4abf130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227a910e-65fc-4842-8dc8-535db4abf130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e12b50-0035-47c9-9a85-b592ff3a0b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume ad11f7d7-a16f-460c-9708-65ca72b1e483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad11f7d7-a16f-460c-9708-65ca72b1e483', 'volume_size': 1} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (c373147a-872f-4e4b-a462-b9dc8bea122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63e6efa-f1a7-4eaf-8215-6fae1513b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63e6efa-f1a7-4eaf-8215-6fae1513b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1682502196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff46630-8a9f-42fa-b16a-15af5d1c3aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:32Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25114331-4d42-4ccc-9562-bdca78810262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25114331-4d42-4ccc-9562-bdca78810262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558bf2da-eb95-4427-8ea9-9bddb2a801a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558bf2da-eb95-4427-8ea9-9bddb2a801a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff46630-8a9f-42fa-b16a-15af5d1c3aae', 'volume_name': 'volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54407650-0f00-4e55-9abc-d3364143f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54407650-0f00-4e55-9abc-d3364143f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f500470-6c9e-4c24-ab8e-210b762fd10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume 0ff46630-8a9f-42fa-b16a-15af5d1c3aae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae', 'volume_size': 1} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:32 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3" returned: 0 in 0.628s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:32 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3 Apr 16 14:45:32 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Flow 'volume_create_manager' (69089cef-7c41-4f92-9d1b-4b18effa63d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf3ee13-8eba-474d-b249-b66ceab7ff36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf3ee13-8eba-474d-b249-b66ceab7ff36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-473665156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a23026-a489-4ea6-85cf-e855b5c2abba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f788b0d1a7db468e909d5facd6c27892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=22c470a4-7c6b-4422-b480-6382cee7071c,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:32Z,use_quota=True,user_id='857941e4bad743d7be60881a22d71f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae4cb89-c939-47ce-b9ac-ca9fd7f3988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae4cb89-c939-47ce-b9ac-ca9fd7f3988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2842273d-3132-4f09-95d5-2ab0d082d7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2842273d-3132-4f09-95d5-2ab0d082d7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '82a23026-a489-4ea6-85cf-e855b5c2abba', 'volume_name': 'volume-82a23026-a489-4ea6-85cf-e855b5c2abba', 'volume_size': 1, 'source_volid': '22c470a4-7c6b-4422-b480-6382cee7071c', 'source_volstatus': 'available'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899b0cd5-9768-427d-b9d2-5887990b1c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899b0cd5-9768-427d-b9d2-5887990b1c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481ea665-57a6-42cb-b73d-3e1f1b165070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Volume 82a23026-a489-4ea6-85cf-e855b5c2abba: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-82a23026-a489-4ea6-85cf-e855b5c2abba', 'volume_size': 1, 'source_volid': '22c470a4-7c6b-4422-b480-6382cee7071c', 'source_volstatus': 'available'} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:32 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a" returned: 0 in 0.701s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e565169-6c6b-463d-99a3-632ee6138a99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb620203-3000-43c8-adc3-87184d1d62c6]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (af5bcda8-dd16-4308-bf6d-1328c00e91ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f181e723-551d-4dd8-a72a-2fea5edc560c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f181e723-551d-4dd8-a72a-2fea5edc560c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1433404130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa272c0f-aa8c-4c46-924e-9577bd69b9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:33Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1564f1a1-089b-427b-ada1-290089ce765c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1564f1a1-089b-427b-ada1-290089ce765c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56953455-9ecb-401b-8096-b366dab90869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56953455-9ecb-401b-8096-b366dab90869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa272c0f-aa8c-4c46-924e-9577bd69b9fa', 'volume_name': 'volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95632353-b251-4cd2-bcc3-58618f0b6795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95632353-b251-4cd2-bcc3-58618f0b6795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd326ae-7580-4116-9c2c-e67e127a7dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume aa272c0f-aa8c-4c46-924e-9577bd69b9fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa', 'volume_size': 1} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (9af1e0db-c784-4b12-9bea-e90386063c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b13945-08b4-45f0-9cc0-60a5ffa24a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b13945-08b4-45f0-9cc0-60a5ffa24a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1815197538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3b8f88-1033-4926-892a-9cc81bd6d6b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:33Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31586bdd-370f-45c2-8104-daab721d3222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31586bdd-370f-45c2-8104-daab721d3222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f118e672-d434-4dcf-8eb2-a43d71076098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f118e672-d434-4dcf-8eb2-a43d71076098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3b8f88-1033-4926-892a-9cc81bd6d6b7', 'volume_name': 'volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098b739f-af54-4219-abee-1a1334b3a8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098b739f-af54-4219-abee-1a1334b3a8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6de425-a833-4df7-90c8-6862b0c95e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:32 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume fb3b8f88-1033-4926-892a-9cc81bd6d6b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7', 'volume_size': 1} Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:32 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:32 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-355ce25e-500c-4da1-93cd-b6eb80e04af3" returned: 0 in 0.540s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-355ce25e-500c-4da1-93cd-b6eb80e04af3" released by "delete_volume" :: held 1.193s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created reservations ['172bbf37-a947-410f-a4de-d6c338d90f64', 'fef76620-44d5-443e-9776-9af30678e304', '6a374308-a3ba-4e7a-9866-e69adf5720ab', '7b1aae14-37b2-4645-ba24-0d03ee2d3692'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:33 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:33 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:33 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99" returned: 0 in 0.527s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:33 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 Apr 16 14:45:33 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:33 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.419s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:33 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Deleted volume successfully. Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-10c02464-79cf-4bf1-a27d-1cf36398ec0d tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-355ce25e-500c-4da1-93cd-b6eb80e04af3-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:33 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-quobyte-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:34 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d" acquired by "delete_volume" :: waited 0.023s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:34 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30fd995-9ed7-442a-803b-8542b08c9ca5]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:34 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:34 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d Apr 16 14:45:34 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:35 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d" returned: 0 in 1.172s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:35 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d Apr 16 14:45:35 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:35 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" returned: 0 in 2.152s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa37ae9-915a-4976-9dc6-481918311c11]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:35 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 Apr 16 14:45:35 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:35 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d" returned: 0 in 0.427s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d" released by "delete_volume" :: held 1.634s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created reservations ['c8e39d74-0f9f-4acc-8768-d3e3dcbf4eab', '662590d2-805a-47a6-bfc8-8992454844db', '6fd3e80c-8d92-48b7-b6f1-43cd1ec3dbc6', '25f4300c-b7ae-4ad2-9a28-9f9f912e891a'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:35 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:35 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:35 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99" returned: 0 in 0.587s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:45:35 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Converted 1024.00 MB image at 475.65 MB/s Apr 16 14:45:35 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 is being set with open permissions: ugo+rw Apr 16 14:45:35 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:35 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 Apr 16 14:45:35 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:36 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.430s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:36 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Deleted volume successfully. Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-6a13073a-7149-4559-b161-2ee1416abd57 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-cf9ca69d-48f6-4c9c-a34b-bf5b4600974d-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-67d4b207-7c28-472e-8d12-d8187f6bc7b3-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-67d4b207-7c28-472e-8d12-d8187f6bc7b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-quobyte-dcfff99c-109e-4a20-8808-09f4ffdbcd62" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-dcfff99c-109e-4a20-8808-09f4ffdbcd62" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-quobyte-67d4b207-7c28-472e-8d12-d8187f6bc7b3" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-67d4b207-7c28-472e-8d12-d8187f6bc7b3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Deleting offline snapshot 67d4b207-7c28-472e-8d12-d8187f6bc7b3 of volume dcfff99c-109e-4a20-8808-09f4ffdbcd62 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] snapshot_file for this snap is: volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[95193cb5-61d0-4cfb-b0ef-a46e9c977648]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:36 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" returned: 0 in 0.433s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" released by "_copy_volume_from_snapshot" :: held 4.502s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-69a3cf26-a723-4d1c-b069-1cb34cd6917a-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" released by "_create_volume_from_snapshot" :: held 4.538s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.593s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.289s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1404326067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ba15ba-9301-4c98-9795-4c3217d84f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:32Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Creating volume f5ba15ba-9301-4c98-9795-4c3217d84f3c {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:36 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:36 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 Apr 16 14:45:36 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:36 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c 1073741824 Apr 16 14:45:36 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b6d9c0-4ccb-4e8a-97e3-5265f2f2b9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60', 'volume_size': 1, 'snapshot_id': '69a3cf26-a723-4d1c-b069-1cb34cd6917a'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0786a3-010a-4cf0-9bf2-c136b7ac7c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:36 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Volume volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 (4fcc8231-dcfe-4110-898d-b6f8ec9bbd60): created successfully Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0786a3-010a-4cf0-9bf2-c136b7ac7c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Flow 'volume_create_manager' (f7871c13-3bf7-4c3e-9a48-d5f843082898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:36 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-4d3d1da6-6c2f-4c7f-bb18-4407560fe0b7 tempest-SnapshotDependencyTests-1110343694 None] Created volume successfully. Apr 16 14:45:36 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3" returned: 0 in 0.505s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27a47e4-a786-4b74-be44-d85e9a31cf0a]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:36 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c 1073741824" returned: 0 in 0.503s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:36 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 Apr 16 14:45:36 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:36 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:36 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c Apr 16 14:45:36 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "cinder-69a3cf26-a723-4d1c-b069-1cb34cd6917a-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-69a3cf26-a723-4d1c-b069-1cb34cd6917a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "cinder-quobyte-1e565169-6c6b-463d-99a3-632ee6138a99" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-1e565169-6c6b-463d-99a3-632ee6138a99" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "cinder-quobyte-69a3cf26-a723-4d1c-b069-1cb34cd6917a" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-69a3cf26-a723-4d1c-b069-1cb34cd6917a" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Deleting offline snapshot 69a3cf26-a723-4d1c-b069-1cb34cd6917a of volume 1e565169-6c6b-463d-99a3-632ee6138a99 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] snapshot_file for this snap is: volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e05e9d-b0eb-4f07-9529-1ec8883b1a96]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:37 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62" returned: 0 in 0.467s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:37 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a Apr 16 14:45:37 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:37 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 Apr 16 14:45:37 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:37 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c" returned: 0 in 0.441s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.020s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794514448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad11f7d7-a16f-460c-9708-65ca72b1e483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:32Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Creating volume ad11f7d7-a16f-460c-9708-65ca72b1e483 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:37 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:UPDATE=251,cinder:SELECT=153,cinder:INSERT=41,cinder:DELETE=15 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29de9e07-fc4d-427a-9198-647455475797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141e4efb-fd07-42a6-9aef-9dd95185ce2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:37 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483 1073741824 Apr 16 14:45:37 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=170,cinder:INSERT=60,cinder:UPDATE=202,cinder:DELETE=29 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:45:37 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c (f5ba15ba-9301-4c98-9795-4c3217d84f3c): created successfully Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141e4efb-fd07-42a6-9aef-9dd95185ce2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (bd6fba15-a91f-49c9-aa5e-9f20cfa0ce9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:37 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-07477838-5937-4b71-898a-fc0744866e4f tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created volume successfully. Apr 16 14:45:37 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a" returned: 0 in 0.513s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e565169-6c6b-463d-99a3-632ee6138a99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1765951-955e-428f-a90d-6ca5caa71027]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:37 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3" returned: 0 in 0.513s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:37 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3 Apr 16 14:45:37 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:37 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 Apr 16 14:45:37 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:37 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483 1073741824" returned: 0 in 0.549s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:37 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:37 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483 Apr 16 14:45:37 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:38 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62.67d4b207-7c28-472e-8d12-d8187f6bc7b3" returned: 0 in 0.436s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-67d4b207-7c28-472e-8d12-d8187f6bc7b3" released by "_delete_snapshot" :: held 1.974s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-dcfff99c-109e-4a20-8808-09f4ffdbcd62" released by "delete_snapshot" :: held 1.986s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:38 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99" returned: 0 in 0.568s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created reservations ['840009d1-7a04-4001-9efa-19432a670836', 'a0f26c30-9ef4-49f6-93a2-f4e6d21dc98d', 'a558d1bb-ecdc-4a98-b526-eac3735c201a', '9b60939d-de0f-4d5f-b5b4-075f33e9fe73'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:38 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a Apr 16 14:45:38 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:38 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Delete snapshot completed successfully. Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3eba60b1-9e63-4947-9660-88c01bf75266 tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-67d4b207-7c28-472e-8d12-d8187f6bc7b3-delete_snapshot" released by "delete_snapshot" :: held 2.102s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:38 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483" returned: 0 in 0.497s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.920s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1682502196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff46630-8a9f-42fa-b16a-15af5d1c3aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:32Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Creating volume 0ff46630-8a9f-42fa-b16a-15af5d1c3aae {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:38 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e12b50-0035-47c9-9a85-b592ff3a0b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad11f7d7-a16f-460c-9708-65ca72b1e483', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3184e8c4-7f7b-47eb-8e8f-1582521b446b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:38 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae 1073741824 Apr 16 14:45:38 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:38 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume volume-ad11f7d7-a16f-460c-9708-65ca72b1e483 (ad11f7d7-a16f-460c-9708-65ca72b1e483): created successfully Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3184e8c4-7f7b-47eb-8e8f-1582521b446b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (590d60f6-c404-4f9c-9526-bda67876d42c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:38 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-feb477a0-03f4-4b44-b88d-983579d29979 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created volume successfully. Apr 16 14:45:38 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a" returned: 0 in 0.479s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:38 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a Apr 16 14:45:38 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:38 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae 1073741824" returned: 0 in 0.481s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:38 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:38 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae Apr 16 14:45:38 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:39 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99.69a3cf26-a723-4d1c-b069-1cb34cd6917a" returned: 0 in 0.410s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-69a3cf26-a723-4d1c-b069-1cb34cd6917a" released by "_delete_snapshot" :: held 2.039s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-1e565169-6c6b-463d-99a3-632ee6138a99" released by "delete_snapshot" :: held 2.055s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Created reservations ['3ee70f0c-a5bd-4461-b362-65990e0024a2', 'ecec3316-6feb-4f14-8b6f-805a870ce7f5', '8d212915-5143-4cef-96ea-47ad4cb1a2bb', 'bc9279d1-5d8d-4a39-ac92-98a08eb46a58'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:39 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Delete snapshot completed successfully. Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-58dc6cda-930b-42d7-8d89-13efb8b927cc tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-69a3cf26-a723-4d1c-b069-1cb34cd6917a-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:39 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae" returned: 0 in 0.435s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.748s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:39 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Cloning volume 22c470a4-7c6b-4422-b480-6382cee7071c to volume 82a23026-a489-4ea6-85cf-e855b5c2abba Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f500470-6c9e-4c24-ab8e-210b762fd10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b544ab52-64fd-4a59-9c9e-2f6661ce128c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:39 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae (0ff46630-8a9f-42fa-b16a-15af5d1c3aae): created successfully Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b544ab52-64fd-4a59-9c9e-2f6661ce128c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (c373147a-872f-4e4b-a462-b9dc8bea122f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Creating offline snapshot 07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 of volume 22c470a4-7c6b-4422-b480-6382cee7071c {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:45:39 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-572282ee-3a3e-4e3f-9fbf-e149228f6f18 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created volume successfully. Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd16dea-6545-4523-9219-2c6f4d8a6a90]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-dcfff99c-109e-4a20-8808-09f4ffdbcd62-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-dcfff99c-109e-4a20-8808-09f4ffdbcd62-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "cinder-quobyte-dcfff99c-109e-4a20-8808-09f4ffdbcd62" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:39 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c Apr 16 14:45:39 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-dcfff99c-109e-4a20-8808-09f4ffdbcd62" acquired by "delete_volume" :: waited 0.007s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5565b814-faf1-46f8-a093-3bf7beb6868c]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:39 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 Apr 16 14:45:39 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:39 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c" returned: 0 in 0.490s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:39 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 1G Apr 16 14:45:39 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:39 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62" returned: 0 in 0.477s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:39 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:40 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62 Apr 16 14:45:40 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "cinder-1e565169-6c6b-463d-99a3-632ee6138a99-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-1e565169-6c6b-463d-99a3-632ee6138a99-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "cinder-quobyte-1e565169-6c6b-463d-99a3-632ee6138a99" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-1e565169-6c6b-463d-99a3-632ee6138a99" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6184cb0b-b23f-41ce-9810-1bb81c5adaf6]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:40 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 1G" returned: 0 in 0.514s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22c470a4-7c6b-4422-b480-6382cee7071c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:40 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 Apr 16 14:45:40 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:40 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22c470a4-7c6b-4422-b480-6382cee7071c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 Apr 16 14:45:40 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:40 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-dcfff99c-109e-4a20-8808-09f4ffdbcd62" returned: 0 in 0.437s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-quobyte-dcfff99c-109e-4a20-8808-09f4ffdbcd62" released by "delete_volume" :: held 0.951s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Created reservations ['64af3226-3ce3-40a0-9a01-6e24916698df', '42b4e808-db1e-43b3-ab4a-2c7603062a1a', 'fcad8c5d-4ea5-4cd2-941f-2182f43ffaf3', '3320e07b-b381-43dc-8194-0bcc7ddb7411'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:40 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:40 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:40 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99" returned: 0 in 0.512s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:40 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22c470a4-7c6b-4422-b480-6382cee7071c -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1" returned: 0 in 0.474s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:40 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 is being set with open permissions: ugo+rw Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:40 devstack sudo[91578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99 Apr 16 14:45:40 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:40 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 Apr 16 14:45:40 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:40 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.410s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:40 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Deleted volume successfully. Apr 16 14:45:40 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5c7a2b1f-1be7-4493-ba4a-40004ac7820e tempest-CreateVolumesFromSnapshotTest-1904082857 None] Lock "cinder-dcfff99c-109e-4a20-8808-09f4ffdbcd62-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:41 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-1e565169-6c6b-463d-99a3-632ee6138a99" returned: 0 in 0.405s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-1e565169-6c6b-463d-99a3-632ee6138a99" released by "delete_volume" :: held 0.944s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:41 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Created reservations ['16edba09-2839-4ed2-a44b-568affa3ac30', '5971f30b-110a-4f9e-8b99-3e83e5a9845c', 'e59a1580-3ef9-42e9-b3ea-376b126dc3a3', 'f0eb6f08-3db0-42a7-bf3d-4a3ce8aedb2e'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1" returned: 0 in 0.445s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:41 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.info Apr 16 14:45:41 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:41 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:41 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "cinder-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "cinder-quobyte-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" acquired by "delete_volume" :: waited 0.018s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[259bb83b-5bc5-415b-95df-af5f6a0d2c62]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:41 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 Apr 16 14:45:41 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:41 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.info" returned: 0 in 0.446s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:41 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.info is being set with open permissions: ugo+rw Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:41 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.info Apr 16 14:45:41 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:41 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.577s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:41 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Deleted volume successfully. Apr 16 14:45:41 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-3fbded14-f3be-495d-92ae-42efe6bc1ec4 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-1e565169-6c6b-463d-99a3-632ee6138a99-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:42 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" returned: 0 in 0.561s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:42 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60 Apr 16 14:45:42 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:42 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.info" returned: 0 in 0.547s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-quobyte-82a23026-a489-4ea6-85cf-e855b5c2abba" by "_copy_volume_from_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-82a23026-a489-4ea6-85cf-e855b5c2abba" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] snapshot: 07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1, volume: 82a23026-a489-4ea6-85cf-e855b5c2abba, {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[11496abe-a8b2-4688-ae23-cc71487519e7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:42 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 Apr 16 14:45:42 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:42 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" returned: 0 in 0.556s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-quobyte-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60" released by "delete_volume" :: held 1.141s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Created reservations ['c96603e1-909b-4443-8825-19744b660219', 'acb75d52-fb33-4911-b484-166fef71212a', '5b747833-b052-48b8-9ad8-1711b30d1198', '77587201-0349-4a76-9a7b-3fc1f12a41ce'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:42 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:42 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:42 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1" returned: 0 in 0.563s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22c470a4-7c6b-4422-b480-6382cee7071c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Creating direct copy from snapshot {{(pid=83305) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d62694-1d14-4f79-bf9a-d52fed5d1a33]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:42 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:43 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c Apr 16 14:45:43 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:43 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.430s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:43 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:43 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Deleted volume successfully. Apr 16 14:45:43 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e13c60e4-f123-47e7-986a-14a8d02818b5 tempest-SnapshotDependencyTests-1110343694 None] Lock "cinder-4fcc8231-dcfe-4110-898d-b6f8ec9bbd60-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:43 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c" returned: 0 in 0.468s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:43 devstack cinder-volume[83305]: DEBUG cinder.utils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Path /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba not found in is_blk_device check {{(pid=83305) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 14:45:43 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:43 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba Apr 16 14:45:43 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:45 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba" returned: 0 in 2.127s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:45 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd59d7d1-9232-463f-8c48-acbc171e640c]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:45 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:45 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c Apr 16 14:45:45 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:46 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c" returned: 0 in 0.623s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG cinder.image.image_utils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c, size 1024.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba {{(pid=83305) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 14:45:46 devstack cinder-volume[83305]: INFO cinder.image.image_utils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Converted 1024.00 MB image at 481.07 MB/s Apr 16 14:45:46 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba is being set with open permissions: ugo+rw Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:46 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba Apr 16 14:45:46 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG oslo_service.periodic_task [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:46 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:46 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:46 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba" returned: 0 in 0.409s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-82a23026-a489-4ea6-85cf-e855b5c2abba" released by "_copy_volume_from_snapshot" :: held 4.248s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-quobyte-07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Deleting offline snapshot 07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 of volume 22c470a4-7c6b-4422-b480-6382cee7071c {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] snapshot_file for this snap is: volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f209d5-3797-4628-a254-65a311c96fae]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:46 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:46 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 Apr 16 14:45:46 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:47 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.487s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:47 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-781faf77-b103-41a8-8ce7-0013e03c92ac None None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:47 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1" returned: 0 in 0.536s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:47 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22c470a4-7c6b-4422-b480-6382cee7071c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:45:47 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[45038d7d-c00e-4710-9773-7b5286dbb021]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:47 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c Apr 16 14:45:47 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:47 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c" returned: 0 in 0.490s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:47 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:47 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 Apr 16 14:45:47 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:48 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1" returned: 0 in 0.478s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:48 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1 Apr 16 14:45:48 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:48 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c.07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1" returned: 0 in 0.435s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-07fdefb7-ea53-44e9-a6eb-3f8f2987dfb1" released by "_delete_snapshot" :: held 2.034s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.362s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.971s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1433404130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa272c0f-aa8c-4c46-924e-9577bd69b9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:33Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Creating volume aa272c0f-aa8c-4c46-924e-9577bd69b9fa {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:48 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481ea665-57a6-42cb-b73d-3e1f1b165070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a23026-a489-4ea6-85cf-e855b5c2abba', 'volume_size': 1, 'source_volid': '22c470a4-7c6b-4422-b480-6382cee7071c', 'source_volstatus': 'available'}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df4c61c-a3fd-43e6-a340-265e60797a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:48 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa 1073741824 Apr 16 14:45:48 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:48 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Volume volume-82a23026-a489-4ea6-85cf-e855b5c2abba (82a23026-a489-4ea6-85cf-e855b5c2abba): created successfully Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df4c61c-a3fd-43e6-a340-265e60797a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:48 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Flow 'volume_create_manager' (69089cef-7c41-4f92-9d1b-4b18effa63d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:48 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a66144bb-acf4-4cce-848b-cca31c39b119 tempest-VolumeDependencyTests-1581818165 None] Created volume successfully. Apr 16 14:45:49 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa 1073741824" returned: 0 in 0.559s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:49 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa Apr 16 14:45:49 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-22c470a4-7c6b-4422-b480-6382cee7071c-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-22c470a4-7c6b-4422-b480-6382cee7071c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-quobyte-22c470a4-7c6b-4422-b480-6382cee7071c" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-22c470a4-7c6b-4422-b480-6382cee7071c" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a06841-b330-493c-82c9-8b395b1b2d46]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:49 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c Apr 16 14:45:49 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:49 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa" returned: 0 in 0.469s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.810s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1815197538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3b8f88-1033-4926-892a-9cc81bd6d6b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647deb3e68f487cbd60161b75a8c2a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:45:33Z,use_quota=True,user_id='db7ab812f02f4872be35ab2f28dfdbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Creating volume fb3b8f88-1033-4926-892a-9cc81bd6d6b7 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:49 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd326ae-7580-4116-9c2c-e67e127a7dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:49 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7 1073741824 Apr 16 14:45:49 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70f5356-fa55-4944-aaa8-b5dccec6bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:49 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa (aa272c0f-aa8c-4c46-924e-9577bd69b9fa): created successfully Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70f5356-fa55-4944-aaa8-b5dccec6bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (af5bcda8-dd16-4308-bf6d-1328c00e91ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:49 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-22399e51-be15-4fc7-9b0d-b68ded71224c tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created volume successfully. Apr 16 14:45:49 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c" returned: 0 in 0.562s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:49 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:49 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c Apr 16 14:45:49 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:50 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7 1073741824" returned: 0 in 0.542s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:50 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7 Apr 16 14:45:50 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:50 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-22c470a4-7c6b-4422-b480-6382cee7071c" returned: 0 in 0.519s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-22c470a4-7c6b-4422-b480-6382cee7071c" released by "delete_volume" :: held 1.110s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Created reservations ['d56b6dfb-c1bd-420c-9575-73a27aa02f01', 'c9ac24fc-9de2-4ddc-aea8-192bc03f078b', '5a865a20-a3f5-49e0-9381-84cd298f7df0', 'b021966e-b42d-4a68-a441-ef86dee5b299'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:50 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:50 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:50 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7" returned: 0 in 0.481s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6de425-a833-4df7-90c8-6862b0c95e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a9f2dc-e868-42ec-b410-2a6daa0e4f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:50 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Volume volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7 (fb3b8f88-1033-4926-892a-9cc81bd6d6b7): created successfully Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a9f2dc-e868-42ec-b410-2a6daa0e4f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:50 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Flow 'volume_create_manager' (9af1e0db-c784-4b12-9bea-e90386063c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:50 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-d423ffbc-6a32-4261-8235-147fbe95b3b5 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created volume successfully. Apr 16 14:45:51 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.452s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:51 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Deleted volume successfully. Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8c5ad78f-5473-4254-9a58-d5f169e8e445 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-22c470a4-7c6b-4422-b480-6382cee7071c-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-fb3b8f88-1033-4926-892a-9cc81bd6d6b7-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-fb3b8f88-1033-4926-892a-9cc81bd6d6b7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-quobyte-fb3b8f88-1033-4926-892a-9cc81bd6d6b7" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-fb3b8f88-1033-4926-892a-9cc81bd6d6b7" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3179d54f-6af0-4bc3-99aa-99cc654ce1d3]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:51 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7 Apr 16 14:45:51 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-82a23026-a489-4ea6-85cf-e855b5c2abba-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-82a23026-a489-4ea6-85cf-e855b5c2abba-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-quobyte-82a23026-a489-4ea6-85cf-e855b5c2abba" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-82a23026-a489-4ea6-85cf-e855b5c2abba" acquired by "delete_volume" :: waited 0.019s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3505374-7ebe-4012-b119-57e763a92ac7]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:51 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba Apr 16 14:45:51 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:51 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7" returned: 0 in 0.479s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:51 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:51 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7 Apr 16 14:45:51 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:52 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba" returned: 0 in 0.469s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:52 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba Apr 16 14:45:52 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:52 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-fb3b8f88-1033-4926-892a-9cc81bd6d6b7" returned: 0 in 0.389s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-fb3b8f88-1033-4926-892a-9cc81bd6d6b7" released by "delete_volume" :: held 0.890s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created reservations ['d590690c-2a2a-4bf7-8a4b-0f29a82a8865', '4c6a43d5-b3f9-4993-800c-4f3048ffb8a1', '8ea5a876-4ca3-429c-b934-f96d9ccfe4f0', '0a1cb52f-826d-469e-aae9-950cdabaaafc'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:52 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:52 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-aa272c0f-aa8c-4c46-924e-9577bd69b9fa-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-aa272c0f-aa8c-4c46-924e-9577bd69b9fa-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-quobyte-aa272c0f-aa8c-4c46-924e-9577bd69b9fa" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-aa272c0f-aa8c-4c46-924e-9577bd69b9fa" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6f5f65-6801-4adf-80d9-578845384d78]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:52 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa Apr 16 14:45:52 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:52 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-82a23026-a489-4ea6-85cf-e855b5c2abba" returned: 0 in 0.457s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-82a23026-a489-4ea6-85cf-e855b5c2abba" released by "delete_volume" :: held 0.946s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Created reservations ['e4d9a693-dbde-4043-bd38-ed0bc4d8579f', 'd7b9789e-00cb-40ac-8e84-a824fab97254', '79603b5a-511d-4204-87c7-89fd0b4c18e1', 'da176fd7-1849-405f-a402-cfcbfcd64035'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:52 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:52 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:52 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.439s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:52 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Deleted volume successfully. Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-9f3a9225-1ac5-4699-8431-d961dbe28485 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-fb3b8f88-1033-4926-892a-9cc81bd6d6b7-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "cinder-quobyte-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d49ca6-f732-4268-be4a-fe828147ff24]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:52 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f Apr 16 14:45:52 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:52 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa" returned: 0 in 0.529s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:52 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:52 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa Apr 16 14:45:52 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:53 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.416s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:53 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Deleted volume successfully. Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5a01fb3b-2b81-403e-af46-37ab15d994dc tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-82a23026-a489-4ea6-85cf-e855b5c2abba-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:53 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" returned: 0 in 0.456s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:53 devstack sudo[91723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f Apr 16 14:45:53 devstack sudo[91723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:53 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aa272c0f-aa8c-4c46-924e-9577bd69b9fa" returned: 0 in 0.427s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-aa272c0f-aa8c-4c46-924e-9577bd69b9fa" released by "delete_volume" :: held 0.990s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created reservations ['551691c3-fb3b-45c0-bd5f-8773007c6010', '030bcd73-2883-49da-a769-ac92c8e65c8a', '2b0f2689-aee9-4014-9f06-8377f7928bf6', '10a2df03-e08d-4ab1-abdd-0a4c8334d853'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:53 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:53 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-0ff46630-8a9f-42fa-b16a-15af5d1c3aae-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-0ff46630-8a9f-42fa-b16a-15af5d1c3aae-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-quobyte-0ff46630-8a9f-42fa-b16a-15af5d1c3aae" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-0ff46630-8a9f-42fa-b16a-15af5d1c3aae" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3daa05-7461-4aa7-84bf-b0901fb69c07]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:53 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae Apr 16 14:45:53 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:53 devstack sudo[91723]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" returned: 0 in 0.452s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-quobyte-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f" released by "delete_volume" :: held 0.937s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Created reservations ['b1a2c0e0-46ee-401d-aae7-9aeca500bd22', 'd3be1b73-dd50-4a6c-bdff-c9bd1d87bf90', '5eacba4d-7d48-4bb8-909f-be16b67cc9b4', '990669b9-ee10-46aa-93c8-9e8ac611d4e8'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:53 devstack sudo[91731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:53 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:53 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.458s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:53 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Deleted volume successfully. Apr 16 14:45:53 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-a1b19bbd-3d16-4925-872e-0b10bf8826b0 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-aa272c0f-aa8c-4c46-924e-9577bd69b9fa-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:54 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae" returned: 0 in 0.500s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:54 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae Apr 16 14:45:54 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:54 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.457s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:54 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Deleted volume successfully. Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-1df88da2-b70a-4a71-9a0e-7b80253df143 tempest-VolumeDependencyTests-1581818165 None] Lock "cinder-da227ee9-3b2d-4bf3-ae29-e78aa6f1676f-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:54 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-0ff46630-8a9f-42fa-b16a-15af5d1c3aae" returned: 0 in 0.434s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-0ff46630-8a9f-42fa-b16a-15af5d1c3aae" released by "delete_volume" :: held 0.957s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created reservations ['60624b7b-fd63-4eba-9c38-ed7fa0b3e432', '419e85c6-faed-4dfd-b09f-f6d183e746d1', 'c93f5ed0-88dd-4bda-8bb5-79cb45ad1d5f', 'c5edd65e-4588-46c9-a029-d17a9081f1a8'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:54 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:54 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-ad11f7d7-a16f-460c-9708-65ca72b1e483-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-ad11f7d7-a16f-460c-9708-65ca72b1e483-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-quobyte-ad11f7d7-a16f-460c-9708-65ca72b1e483" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-ad11f7d7-a16f-460c-9708-65ca72b1e483" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e2f552-7909-49b7-9dec-7521d6be85f9]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:54 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483 Apr 16 14:45:54 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:54 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.455s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:54 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:55 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Deleted volume successfully. Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-63bf4eb9-de01-41fb-bd95-db31eeb1fbbb tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-0ff46630-8a9f-42fa-b16a-15af5d1c3aae-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:55 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483" returned: 0 in 0.493s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:55 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483 Apr 16 14:45:55 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:55 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-ad11f7d7-a16f-460c-9708-65ca72b1e483" returned: 0 in 0.407s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-ad11f7d7-a16f-460c-9708-65ca72b1e483" released by "delete_volume" :: held 0.926s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created reservations ['f3076d24-cbb2-4ebd-bb22-25fe64822441', 'c16d5056-dea1-4658-b5f3-f509863d294b', '681fc3a8-0dde-42a8-a707-be9fa1593be8', 'ed4a6140-f537-4683-b34c-7699661b5d42'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:55 devstack sudo[91753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:55 devstack sudo[91753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-f5ba15ba-9301-4c98-9795-4c3217d84f3c-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-f5ba15ba-9301-4c98-9795-4c3217d84f3c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-quobyte-f5ba15ba-9301-4c98-9795-4c3217d84f3c" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-f5ba15ba-9301-4c98-9795-4c3217d84f3c" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a91d746-d083-482a-aef1-34738e8bf3a2]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:55 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:55 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c Apr 16 14:45:55 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:56 devstack sudo[91753]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.456s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:56 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Deleted volume successfully. Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-05876975-f1cd-4b8b-8495-a95c01eb1889 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-ad11f7d7-a16f-460c-9708-65ca72b1e483-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:56 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c" returned: 0 in 0.442s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:56 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c Apr 16 14:45:56 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:56 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-f5ba15ba-9301-4c98-9795-4c3217d84f3c" returned: 0 in 0.421s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-f5ba15ba-9301-4c98-9795-4c3217d84f3c" released by "delete_volume" :: held 0.896s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created reservations ['3ac1c8b4-ec3f-487f-80ac-30c6669c0cf3', '86082315-6fd4-4e09-83ff-756099be3ed2', '64c2a841-ecd3-4e94-9932-099e390579b1', '8cd90451-e7d3-47d8-8d5c-e0956e5ce859'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:56 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:56 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-aeef6f89-ecdf-4e93-9c1f-13446ff2d755-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-aeef6f89-ecdf-4e93-9c1f-13446ff2d755-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "cinder-quobyte-aeef6f89-ecdf-4e93-9c1f-13446ff2d755" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-aeef6f89-ecdf-4e93-9c1f-13446ff2d755" acquired by "delete_volume" :: waited 0.009s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca427c6c-da77-4069-901d-6b2964c856e0]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:45:56 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:56 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755 Apr 16 14:45:56 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:57 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.401s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:57 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Deleted volume successfully. Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-469028c2-3d0e-4551-9978-03fdebb1c6a6 tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-f5ba15ba-9301-4c98-9795-4c3217d84f3c-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:57 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755" returned: 0 in 0.517s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:57 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755 Apr 16 14:45:57 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:57 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-aeef6f89-ecdf-4e93-9c1f-13446ff2d755" returned: 0 in 0.404s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-quobyte-aeef6f89-ecdf-4e93-9c1f-13446ff2d755" released by "delete_volume" :: held 0.942s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Created reservations ['04f734cf-5d6f-4c20-8691-77593c83e5d8', 'bb293eca-292d-4667-8972-fb32e24f2238', '88912898-44f8-474a-bde1-694e444a15cf', '97ddeb09-b749-46e8-b1b9-9d823ca73120'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:57 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:57 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:45:57 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:45:58 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Apr 16 14:45:58 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.465s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:45:58 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:45:58 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Deleted volume successfully. Apr 16 14:45:58 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-8fbff89c-9010-489c-ae7f-a97e032056ff tempest-CreateVolumesFromSourceVolumeTest-1121180671 None] Lock "cinder-aeef6f89-ecdf-4e93-9c1f-13446ff2d755-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Flow 'volume_create_manager' (b4fa04bf-bde0-40e0-9700-bbe4f809c7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a60ae44-f636-41d0-b577-7413fccfc4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a60ae44-f636-41d0-b577-7413fccfc4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6287668a-f5af-4aff-afc0-6df324fb9db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58a835b138b04249a5fc2852cf466261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:46:00Z,use_quota=True,user_id='767fa2be26744b68bade9fd0f65ee6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8a0843-a66a-48da-a01c-a8a4c5a40d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8a0843-a66a-48da-a01c-a8a4c5a40d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d946f97a-e82f-4ccb-a99d-9f2ab9520976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d946f97a-e82f-4ccb-a99d-9f2ab9520976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6287668a-f5af-4aff-afc0-6df324fb9db2', 'volume_name': 'volume-6287668a-f5af-4aff-afc0-6df324fb9db2', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1309096b-13f1-4f76-9053-7870ea072f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1309096b-13f1-4f76-9053-7870ea072f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e044b0b-7fb7-4eff-a33c-e31af06c7631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:45:59 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Volume 6287668a-f5af-4aff-afc0-6df324fb9db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6287668a-f5af-4aff-afc0-6df324fb9db2', 'volume_size': 1} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6287668a-f5af-4aff-afc0-6df324fb9db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58a835b138b04249a5fc2852cf466261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:46:00Z,use_quota=True,user_id='767fa2be26744b68bade9fd0f65ee6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Creating volume 6287668a-f5af-4aff-afc0-6df324fb9db2 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:45:59 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:45:59 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:45:59 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2 1073741824 Apr 16 14:45:59 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:00 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2 1073741824" returned: 0 in 0.479s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:00 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2 Apr 16 14:46:00 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:00 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2" returned: 0 in 0.384s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e044b0b-7fb7-4eff-a33c-e31af06c7631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6287668a-f5af-4aff-afc0-6df324fb9db2', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab59650-ca9e-4d7a-83ba-51751cc287f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:46:00 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Volume volume-6287668a-f5af-4aff-afc0-6df324fb9db2 (6287668a-f5af-4aff-afc0-6df324fb9db2): created successfully Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab59650-ca9e-4d7a-83ba-51751cc287f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Flow 'volume_create_manager' (b4fa04bf-bde0-40e0-9700-bbe4f809c7f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:46:00 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-aa8a4d4b-642b-4984-a2fa-08efcaa5b932 tempest-CinderUnicodeTest-1658403928 None] Created volume successfully. Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83305) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Flow 'volume_create_manager' (3a054440-99a5-4819-983d-a98c4e978228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa9134b-2d59-4dc0-b167-cc9c3f4ef1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa9134b-2d59-4dc0-b167-cc9c3f4ef1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:46:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2038987560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d967db-d378-460f-b19d-6bb892ed5801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58a835b138b04249a5fc2852cf466261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:46:01Z,use_quota=True,user_id='767fa2be26744b68bade9fd0f65ee6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec334738-c6fd-4833-b08a-4049119a0805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec334738-c6fd-4833-b08a-4049119a0805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406a2640-2bf0-42d8-960c-d2f3389babb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406a2640-2bf0-42d8-960c-d2f3389babb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d967db-d378-460f-b19d-6bb892ed5801', 'volume_name': 'volume-96d967db-d378-460f-b19d-6bb892ed5801', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8b2e66-5f1e-4cea-bb97-9645a9bccf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8b2e66-5f1e-4cea-bb97-9645a9bccf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847de6c5-27ab-40c1-bba6-04b7c8775f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:46:00 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Volume 96d967db-d378-460f-b19d-6bb892ed5801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d967db-d378-460f-b19d-6bb892ed5801', 'volume_size': 1} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T12:46:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2038987560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d967db-d378-460f-b19d-6bb892ed5801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58a835b138b04249a5fc2852cf466261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T12:46:01Z,use_quota=True,user_id='767fa2be26744b68bade9fd0f65ee6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbd035c-a181-445d-9c18-423ae2a11f5b),volume_type_id=1cbd035c-a181-445d-9c18-423ae2a11f5b)}" {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Creating volume 96d967db-d378-460f-b19d-6bb892ed5801 {{(pid=83305) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Selected osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 as target Quobyte volume. {{(pid=83305) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 14:46:00 devstack cinder-volume[83305]: INFO cinder.volume.drivers.remotefs [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] casted to osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5 Apr 16 14:46:00 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 1073741824 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:00 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 1073741824 Apr 16 14:46:00 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:01 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 1073741824" returned: 0 in 0.473s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:01 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 Apr 16 14:46:01 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:01 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801" returned: 0 in 0.391s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:01 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'} {{(pid=83305) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 14:46:01 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:46:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847de6c5-27ab-40c1-bba6-04b7c8775f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d967db-d378-460f-b19d-6bb892ed5801', 'volume_size': 1}' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:46:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd50a0f-6840-4427-abbf-c5897c334738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 14:46:01 devstack cinder-volume[83305]: INFO cinder.volume.flows.manager.create_volume [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Volume volume-96d967db-d378-460f-b19d-6bb892ed5801 (96d967db-d378-460f-b19d-6bb892ed5801): created successfully Apr 16 14:46:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd50a0f-6840-4427-abbf-c5897c334738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83305) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 14:46:01 devstack cinder-volume[83305]: DEBUG cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Flow 'volume_create_manager' (3a054440-99a5-4819-983d-a98c4e978228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83305) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 14:46:01 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-6e9abf48-2d41-451c-bbc0-8bb79c2fa5f1 tempest-CinderUnicodeTest-1658403928 None] Created volume successfully. Apr 16 14:46:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:46:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:46:02 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] Creating offline snapshot 5b66a04e-1410-459f-8f48-4344c4a8630b of volume 96d967db-d378-460f-b19d-6bb892ed5801 {{(pid=83305) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 14:46:02 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bc628e-cbe0-4908-b2a9-642c5baf983b]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:46:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:02 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 Apr 16 14:46:02 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:02 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801" returned: 0 in 0.489s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:02 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b 1G {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:02 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b 1G Apr 16 14:46:02 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:03 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b 1G" returned: 0 in 0.463s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d967db-d378-460f-b19d-6bb892ed5801 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:03 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d967db-d378-460f-b19d-6bb892ed5801 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b Apr 16 14:46:03 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:03 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d967db-d378-460f-b19d-6bb892ed5801 -F qcow2 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b" returned: 0 in 0.422s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:03 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b is being set with open permissions: ugo+rw Apr 16 14:46:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:03 devstack sudo[91810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b Apr 16 14:46:03 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:03 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b" returned: 0 in 0.405s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:03 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:03 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.info Apr 16 14:46:03 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:04 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.info" returned: 0 in 0.414s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:04 devstack cinder-volume[83305]: WARNING cinder.volume.drivers.remotefs [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.info is being set with open permissions: ugo+rw Apr 16 14:46:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.info {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:04 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.info Apr 16 14:46:04 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:04 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.info" returned: 0 in 0.394s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:04 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:46:04 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-94e1df08-a95a-4202-8869-b6ad6c12ff2a tempest-CinderUnicodeTest-1658403928 None] Create snapshot completed successfully Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "cinder-5b66a04e-1410-459f-8f48-4344c4a8630b-delete_snapshot" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-5b66a04e-1410-459f-8f48-4344c4a8630b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "cinder-quobyte-96d967db-d378-460f-b19d-6bb892ed5801" by "delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-quobyte-96d967db-d378-460f-b19d-6bb892ed5801" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "cinder-quobyte-5b66a04e-1410-459f-8f48-4344c4a8630b" by "_delete_snapshot" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-quobyte-5b66a04e-1410-459f-8f48-4344c4a8630b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Deleting offline snapshot 5b66a04e-1410-459f-8f48-4344c4a8630b of volume 96d967db-d378-460f-b19d-6bb892ed5801 {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] snapshot_file for this snap is: volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b {{(pid=83305) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[028245c7-7eb3-4b86-a9e5-8805dd88b823]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:05 devstack sudo[91820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b Apr 16 14:46:05 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:05 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b" returned: 0 in 0.450s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.remotefs [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96d967db-d378-460f-b19d-6bb892ed5801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83305) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54a080a-ce52-47f3-baed-05e9d9c2cda3]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:46:05 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:05 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 Apr 16 14:46:05 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:06 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801" returned: 0 in 0.443s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:06 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b Apr 16 14:46:06 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:06 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b" returned: 0 in 0.423s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:06 devstack sudo[91835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b Apr 16 14:46:06 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:06 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:06 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801.5b66a04e-1410-459f-8f48-4344c4a8630b" returned: 0 in 0.387s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-quobyte-5b66a04e-1410-459f-8f48-4344c4a8630b" released by "_delete_snapshot" :: held 1.752s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-quobyte-96d967db-d378-460f-b19d-6bb892ed5801" released by "delete_snapshot" :: held 1.767s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Created reservations ['df57a4b8-1ad3-43c6-948c-c513d5ebf22c', 'f407e24e-9163-4e08-a09c-14620bbe7c38', 'd0678963-3785-4862-932c-c73251de3121', '50f51ed5-89a6-4c73-b875-91211e1195d3'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:46:07 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Delete snapshot completed successfully. Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-cdc06929-5bfa-44fa-a403-5620e1430623 tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-5b66a04e-1410-459f-8f48-4344c4a8630b-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "cinder-96d967db-d378-460f-b19d-6bb892ed5801-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-96d967db-d378-460f-b19d-6bb892ed5801-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "cinder-quobyte-96d967db-d378-460f-b19d-6bb892ed5801" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-quobyte-96d967db-d378-460f-b19d-6bb892ed5801" acquired by "delete_volume" :: waited 0.006s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ca1730-0d32-4100-84f6-270a9af35ca0]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:07 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 Apr 16 14:46:07 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:07 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801" returned: 0 in 0.460s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:07 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:07 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801 Apr 16 14:46:07 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:08 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-96d967db-d378-460f-b19d-6bb892ed5801" returned: 0 in 0.384s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-quobyte-96d967db-d378-460f-b19d-6bb892ed5801" released by "delete_volume" :: held 0.885s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Created reservations ['52e2dae4-f956-4341-b1b2-79f83fd5849e', '72c4a2a1-38d7-4174-9a86-fee492858357', '120a1a8a-cecb-44ed-a575-a07dc5a54af5', '0a73fb76-ee99-4c46-9d63-9c8283b8e3e4'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:08 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:46:08 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "cinder-6287668a-f5af-4aff-afc0-6df324fb9db2-delete_volume" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-6287668a-f5af-4aff-afc0-6df324fb9db2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "cinder-quobyte-6287668a-f5af-4aff-afc0-6df324fb9db2" by "delete_volume" {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-quobyte-6287668a-f5af-4aff-afc0-6df324fb9db2" acquired by "delete_volume" :: waited 0.013s {{(pid=83305) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f08b3e1-81b5-494c-ac49-6c36c926b356]: (4, 'qcow2') {{(pid=84284) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:08 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2 Apr 16 14:46:08 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:08 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.416s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:46:08 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Deleted volume successfully. Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-5faff014-a142-41de-bdc2-3d45607de723 tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-96d967db-d378-460f-b19d-6bb892ed5801-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:46:08 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2" returned: 0 in 0.449s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:08 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2 {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:08 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2 Apr 16 14:46:08 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:09 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d/volume-6287668a-f5af-4aff-afc0-6df324fb9db2" returned: 0 in 0.400s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-quobyte-6287668a-f5af-4aff-afc0-6df324fb9db2" released by "delete_volume" :: held 0.869s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG cinder.quota [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Created reservations ['01097605-cec0-4197-b4ef-822e51177b75', '7cd84619-16c9-4f81-a5bc-01320b3905b3', '506ee587-bc6c-4f7b-84ae-841c3088d967', 'b17ad9f0-d051-461b-889d-d4e504d5a244'] {{(pid=83305) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5': None} {{(pid=83305) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG cinder.volume.drivers.quobyte [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c6509b8-bc36-433a-80aa-f139ece5cfa5'] {{(pid=83305) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.lockutils [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 14:46:09 devstack sudo[91857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d Apr 16 14:46:09 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 14:46:09 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG oslo_concurrency.processutils [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ab0799f3cc0fc29e1619d3615e5310d" returned: 0 in 0.425s {{(pid=83305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG cinder.manager [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Notifying Schedulers of capabilities ... {{(pid=83305) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 14:46:09 devstack cinder-volume[83305]: INFO cinder.volume.manager [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Deleted volume successfully. Apr 16 14:46:09 devstack cinder-volume[83305]: DEBUG cinder.coordination [None req-e3b9d8f1-a720-48e9-8191-4e1e8902504e tempest-CinderUnicodeTest-1658403928 None] Lock "cinder-6287668a-f5af-4aff-afc0-6df324fb9db2-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=83305) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 14:46:19 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:UPDATE=134,cinder:DELETE=16,cinder:SELECT=97,cinder:INSERT=34 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 14:46:19 devstack cinder-volume[83305]: DEBUG dbcounter [-] [83305] Writing DB stats cinder:SELECT=105,cinder:UPDATE=167,cinder:INSERT=44,cinder:DELETE=7 {{(pid=83305) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}